Jun 23 12:32:59 devstack cinder-volume[82573]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 12:32:59 devstack cinder-volume[82573]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 12:32:59 devstack cinder-volume[82573]: we strongly recommend against using it for new projects. Jun 23 12:32:59 devstack cinder-volume[82573]: If you are already using Eventlet, we recommend migrating to a different Jun 23 12:32:59 devstack cinder-volume[82573]: framework. For more detail see Jun 23 12:32:59 devstack cinder-volume[82573]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 12:32:59 devstack cinder-volume[82573]: import eventlet # noqa Jun 23 12:33:02 devstack cinder-volume[82573]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 12:33:02 devstack cinder-volume[82573]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 12:33:02 devstack cinder-volume[82573]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 12:33:03 devstack cinder-volume[82573]: INFO dbcounter [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Registered counter for database cinder Jun 23 12:33:03 devstack cinder-volume[82573]: DEBUG oslo_db.sqlalchemy.engines [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:33:03 devstack cinder-volume[82573]: DEBUG dbcounter [-] [82573] Writer thread running {{(pid=82573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 12:33:03 devstack cinder-volume[82573]: INFO cinder.rpc [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 12:33:03 devstack cinder-volume[82573]: INFO cinder.rpc [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 12:33:03 devstack cinder-volume[82573]: DEBUG oslo_db.sqlalchemy.engines [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:33:03 devstack cinder-volume[82573]: INFO cinder.volume.manager [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Determined volume DB was empty at startup. Jun 23 12:33:03 devstack cinder-volume[82573]: DEBUG cinder.volume.manager [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82573) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 12:33:03 devstack cinder-volume[82573]: INFO cinder.volume.manager [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 12:33:03 devstack cinder-volume[82573]: WARNING stevedore.named [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 12:33:03 devstack cinder-volume[82573]: WARNING castellan.key_manager [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 12:33:03 devstack cinder-volume[82573]: WARNING cinder.keymgr.conf_key_mgr [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 12:33:03 devstack cinder-volume[82573]: DEBUG cinder.volume.drivers.lvm [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82573) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 23 12:33:03 devstack cinder-volume[82573]: DEBUG oslo_concurrency.processutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_concurrency.processutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] CMD "cinder-rtstool verify" returned: 0 in 0.460s {{(pid=82573) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_db.sqlalchemy.engines [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:33:04 devstack cinder-volume[82573]: INFO cinder.rpc [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 23 12:33:04 devstack cinder-volume[82573]: INFO cinder.rpc [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 23 12:33:04 devstack cinder-volume[82573]: WARNING stevedore.named [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 12:33:04 devstack cinder-volume[82573]: WARNING castellan.key_manager [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 12:33:04 devstack cinder-volume[82573]: INFO cinder.volume.manager [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_db.sqlalchemy.engines [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82573) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:33:04 devstack cinder-volume[82573]: INFO oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Starting 1 workers Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Started child 82749 {{(pid=82573) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Full set of CONF: {{(pid=82573) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] ******************************************************************************** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Configuration options gathered from: {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] ================================================================================ {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] allow_availability_zone_fallback = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] allow_compression_on_image_upload = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] allowed_direct_url_schemes = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] api_rate_limit = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] auth_strategy = keystone {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] az_cache_duration = 3600 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82749]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_availability_zone = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_host = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_stats_polling_interval = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backup_api_class = cinder.backup.api.API {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backup_name_template = backup-%s {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backup_use_same_host = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backup_use_temp_snapshot = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] chap_password = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] chap_username = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_internal_tenant_project_id = a4a779c9710d46289ad302c996b7d627 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_internal_tenant_user_id = 949a37a24de54c7a90e00f304ad63bf9 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cloned_volume_same_az = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cluster = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] compression_format = gzip {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] compute_api_class = cinder.compute.nova.API {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] config_dir = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] config_source = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] control_exchange = openstack {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] debug = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] default_availability_zone = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] default_group_type = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] default_volume_type = lvmdriver-1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] disk_geometry = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] driver_client_cert = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] driver_client_cert_key = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] driver_data_namespace = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] driver_ssl_cert_path = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] driver_ssl_cert_verify = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] driver_use_ssl = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] enable_force_upload = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] enable_new_services = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] enable_unsupported_driver = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] enforce_multipath_for_image_xfer = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] filter_function = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_api_insecure = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_api_ssl_compression = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_ca_certificates_file = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_catalog_info = image:glance:publicURL {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_num_retries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance_request_timeout = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] goodness_function = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] graceful_shutdown_timeout = 5 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] group_api_class = cinder.group.api.API {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] host = devstack {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_compress_on_upload = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_conversion_address_space_limit = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_conversion_cpu_limit = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_conversion_disable = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_upload_use_cinder_backend = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_upload_use_internal_tenant = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_volume_cache_enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_volume_cache_max_count = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] image_volume_cache_max_size_gb = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] init_host_max_objects_retrieval = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] instance_format = [instance: %(uuid)s] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] iscsi_target_flags = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] iscsi_write_cache = on {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] iser_helper = tgtadm {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] iser_ip_address = 192.168.122.34 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] iser_port = 3260 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_color = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_config_append = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_dir = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_file = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_options = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_rotate_interval = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_rotate_interval_type = days {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] log_rotation_type = none {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] max_age = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] max_logfile_count = 30 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] max_logfile_size_mb = 200 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] max_over_subscription_ratio = 20.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] message_reap_interval = 86400 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] message_ttl = 2592000 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] migration_create_volume_timeout_secs = 300 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] monkey_patch = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] monkey_patch_modules = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] my_ip = 192.168.122.34 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] no_snapshot_gb_quota = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] num_iser_scan_tries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] num_shell_tries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] num_volume_device_scan_tries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] nvmeof_conn_info_version = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] nvmet_ns_id = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] nvmet_port_id = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] osapi_max_limit = 1000 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] osapi_volume_ext_list = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82749]: INFO cinder.volume.manager [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] osapi_volume_listen_port = 8776 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] osapi_volume_use_ssl = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] osapi_volume_workers = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] per_volume_size_limit = -1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] periodic_fuzzy_delay = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] periodic_interval = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] public_endpoint = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] publish_errors = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] quota_backup_gigabytes = 1000 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] quota_backups = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] quota_gigabytes = 1000 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] quota_groups = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] quota_snapshots = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] quota_volumes = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] rate_limit_burst = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] rate_limit_except_level = CRITICAL {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] rate_limit_interval = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] reinit_driver_count = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] replication_device = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] report_discard_supported = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] report_interval = 120 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] reservation_clean_interval = 86400 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] reservation_expire = 86400 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] reserved_image_namespaces = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] reserved_percentage = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] rpc_response_timeout = 120 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] run_external_periodic_tasks = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] scst_target_driver = iscsi {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] scst_target_iqn_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_down_time = 720 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] shell_completion = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] snapshot_name_template = snapshot-%s {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] snapshot_same_host = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] split_loggers = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] state_path = /opt/stack/data/cinder {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] storage_availability_zone = nova {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] storage_protocol = iSCSI {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] syslog_log_facility = LOG_USER {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] target_helper = lioadm {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] target_ip_address = 192.168.122.34 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] target_port = 3260 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] target_protocol = iscsi {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] target_secondary_ip_addresses = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] trace_flags = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] transport_url = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] until_refresh = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] use_chap_auth = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] use_default_quota_class = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] use_journal = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] use_json = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] use_multipath_for_image_xfer = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] use_stderr = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] use_syslog = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] verify_glance_signatures = enabled {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_api_class = cinder.volume.api.API {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_backend_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_clear = zero {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_clear_ionice = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_clear_size = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_copy_bps_limit = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_dd_blocksize = 1M {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_name_template = volume-%s {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_service_inithost_offload = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volume_usage_audit_period = month {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] zoning_mode = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_concurrency.disable_process_locking = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.auth_section = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.auth_type = password {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.auth_version = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.cache = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.include_service_catalog = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.insecure = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.interface = public {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_password = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcache_username = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.region_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.service_type = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.backend = dogpile.cache.null {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.backend_argument = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.backend_expiration_time = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.config_prefix = cache.oslo {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.debug_cache_backend = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.enable_retry_client = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.enable_socket_keepalive = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.expiration_time = 600 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack sudo[82754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.hashclient_retry_attempts = 2 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.memcache_dead_retry = 300 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.memcache_pool_maxsize = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack sudo[82754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.memcache_sasl_enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.password = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.proxies = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.redis_db = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.redis_server = localhost:6379 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.retry_attempts = 2 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.retry_delay = 0.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.socket_keepalive_count = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.socket_keepalive_idle = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.socket_keepalive_interval = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.socket_timeout = 1.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.tls_allowed_ciphers = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.tls_cafile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.tls_certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.tls_enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.tls_keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cache.username = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] coordination.backend_url = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.asyncio_connection = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.asyncio_slave_connection = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.backend = sqlalchemy {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.connection = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.connection_debug = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.connection_parameters = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.connection_recycle_time = 3600 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.connection_trace = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.db_inc_retry_interval = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.db_max_retries = 20 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.db_max_retry_interval = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.db_retry_interval = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.max_overflow = 50 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.max_pool_size = 5 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.max_retries = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.mysql_wsrep_sync_wait = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.pool_timeout = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.retry_interval = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.slave_connection = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.sqlite_synchronous = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.synchronous_reader = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] database.use_db_reconnect = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.connection_string = messaging:// {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.es_doc_type = notification {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.es_scroll_size = 10000 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.es_scroll_time = 2m {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.filter_error_trace = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.hmac_keys = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.sentinel_service_name = mymaster {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.socket_timeout = 0.1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.trace_requests = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler.trace_sqlalchemy = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler_jaeger.process_tags = {} {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler_jaeger.service_name_prefix = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] profiler_otlp.service_name_prefix = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.enforce_new_defaults = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: WARNING oslo_config.cfg [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.enforce_scope = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.policy_default_rule = default {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.policy_file = policy.yaml {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] privsep_osbrick.group = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] privsep_osbrick.helper_command = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] privsep_osbrick.user = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_sys_admin.group = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_sys_admin.helper_command = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] cinder_sys_admin.user = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.auth_section = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.auth_type = password {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.cafile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.collect_timing = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.insecure = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.send_service_user_token = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.split_loggers = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] service_user.timeout = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.auth_section = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.auth_type = password {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.collect_timing = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.insecure = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.region_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.split_loggers = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] glance.timeout = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.backend_availability_zone = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.chap_password = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.chap_username = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.disk_geometry = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.driver_client_cert = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.driver_client_cert_key = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.driver_data_namespace = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.driver_use_ssl = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.extra_capabilities = {} {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.filter_function = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.goodness_function = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.iscsi_target_flags = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.iscsi_write_cache = on {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.iser_helper = tgtadm {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.iser_port = 3260 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.lvm_share_target = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.lvm_type = auto {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.num_shell_tries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.replication_device = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.report_discard_supported = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.reserved_percentage = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.target_helper = tgtadm {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.target_port = 3260 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.target_protocol = iscsi {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.trace_flags = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.unique_fqdn_network = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.use_chap_auth = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_backend_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_clear = zero {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_clear_ionice = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_clear_size = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_reports.file_event_handler = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_reports.log_dir = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.backend_host = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.chap_password = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.chap_username = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.disk_geometry = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.driver_client_cert = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.extra_capabilities = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.filter_function = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.goodness_function = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.iser_helper = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.iser_ip_address = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.iser_port = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.lvm_share_target = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.lvm_type = auto {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.num_shell_tries = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.replication_device = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.report_discard_supported = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.reserved_percentage = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.scst_target_driver = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.storage_protocol = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.target_helper = lioadm {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.target_ip_address = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.target_port = 3260 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.trace_flags = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.use_chap_auth = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_clear = zero {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_clear_size = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] lvmdriver-1.volumes_dir = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.ssl = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_notifications.driver = [] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_notifications.retry = -1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] key_manager.fixed_key = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.barbican_api_version = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.barbican_endpoint = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.barbican_endpoint_type = public {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.barbican_region_name = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.cafile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.collect_timing = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.insecure = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.number_of_retries = 60 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.retry_delay = 1 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.send_service_user_token = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.split_loggers = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.timeout = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.verify_ssl = True {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican.verify_ssl_path = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.auth_section = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.auth_type = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.cafile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.certfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.collect_timing = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.insecure = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.keyfile = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.split_loggers = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] barbican_service_user.timeout = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.approle_role_id = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.approle_secret_id = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.kv_mountpoint = secret {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.kv_path = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.kv_version = 2 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.namespace = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.root_token_id = **** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.ssl_ca_crt_file = None {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.timeout = 60.0 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.use_ssl = False {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:33:04 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] ******************************************************************************** {{(pid=82573) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 12:33:05 devstack sudo[82754]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:05 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:05 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:05 devstack sudo[82920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:05 devstack sudo[82920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:06 devstack sudo[82920]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.642s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:33:06 devstack cinder-volume[82749]: INFO cinder.brick.local_dev.lvm [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:06 devstack sudo[83179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:33:06 devstack sudo[83179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:06 devstack sudo[83179]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG cinder.brick.local_dev.lvm [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82749) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 23 12:33:06 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:06 devstack sudo[83321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:06 devstack sudo[83321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:07 devstack sudo[83321]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:07 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.022s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:07 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:07 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:07 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:07 devstack sudo[83529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:07 devstack sudo[83529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:08 devstack sudo[83529]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:08 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.676s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:08 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:08 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:08 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:08 devstack sudo[83535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 23 12:33:08 devstack sudo[83535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:09 devstack sudo[83535]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:09 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.660s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:09 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:09 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:33:09 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:09 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:09 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:09 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:09 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:33:09 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:10 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:10 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.887s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:10 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:10 devstack sudo[83555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:33:10 devstack sudo[83555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:11 devstack sudo[83555]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.726s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:11 devstack sudo[83560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:11 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:12 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.826s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:12 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:12 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:13 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.873s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:13 devstack cinder-volume[82749]: INFO cinder.volume.drivers.lvm [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 23 12:33:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:13 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:13 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:13 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.663s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:13 devstack cinder-volume[82749]: DEBUG cinder.volume.drivers.lvm [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Updating volume stats {{(pid=82749) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 12:33:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:13 devstack sudo[83695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:33:13 devstack sudo[83695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:14 devstack sudo[83695]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:14 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:14 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:14 devstack cinder-volume[82573]: DEBUG dbcounter [-] [82573] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82573) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:33:14 devstack sudo[83835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:33:14 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:15 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:15 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:15 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:15 devstack sudo[83841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:15 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:15 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:15 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:15 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:15 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:33:15 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:16 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:16 devstack cinder-volume[82749]: INFO cinder.volume.driver [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG cinder.volume.driver [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82749) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG oslo_db.sqlalchemy.engines [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82749) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG dbcounter [-] [82749] Writer thread running {{(pid=82749) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG cinder.db.api [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Building query based on filter {{(pid=82749) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG cinder.image.image_utils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82749) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 12:33:16 devstack cinder-volume[82749]: INFO cinder.keymgr.migration [None req-de538914-05e8-47b1-9eb4-6449846cad78 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG cinder.volume.drivers.lvm [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Updating volume stats {{(pid=82749) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 12:33:16 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:16 devstack sudo[83849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:33:16 devstack sudo[83849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:17 devstack sudo[83849]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:17 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:17 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:17 devstack sudo[83855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:33:17 devstack sudo[83855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:17 devstack sudo[83855]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:17 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:17 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:17 devstack sudo[83859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:17 devstack sudo[83859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:18 devstack sudo[83859]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:18 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:18 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:18 devstack sudo[83862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:33:18 devstack sudo[83862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:19 devstack sudo[83862]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:19 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:19 devstack cinder-volume[82749]: DEBUG cinder.manager [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Notifying Schedulers of capabilities ... {{(pid=82749) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:33:19 devstack cinder-volume[82749]: INFO cinder.volume.manager [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Driver initialization completed successfully. Jun 23 12:33:19 devstack cinder-volume[82749]: INFO cinder.manager [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Initiating service 2 cleanup Jun 23 12:33:19 devstack cinder-volume[82749]: INFO cinder.manager [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Service 2 cleanup completed. Jun 23 12:33:19 devstack cinder-volume[82749]: DEBUG cinder.service [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Creating RPC server for service cinder-volume {{(pid=82749) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 12:33:19 devstack cinder-volume[82749]: DEBUG cinder.service [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82749) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 12:33:19 devstack cinder-volume[82749]: INFO cinder.volume.manager [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 23 12:33:19 devstack cinder-volume[82749]: DEBUG cinder.volume.drivers.lvm [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Updating volume stats {{(pid=82749) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 12:33:19 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:19 devstack sudo[83866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:33:19 devstack sudo[83866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:20 devstack sudo[83866]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:20 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:20 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:20 devstack sudo[83870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:33:20 devstack sudo[83870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:20 devstack sudo[83870]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:20 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:20 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:20 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:33:20 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:21 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:21 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.650s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:21 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:33:21 devstack sudo[83933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:33:21 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:33:21 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root Jun 23 12:33:21 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:33:21 devstack cinder-volume[82749]: INFO cinder.volume.manager [None req-97510eea-5494-4b79-b5a9-923aef857242 None None] Driver post RPC initialization completed successfully. Jun 23 12:33:31 devstack cinder-volume[82749]: DEBUG dbcounter [-] [82749] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82749) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:33:31 devstack cinder-volume[82749]: DEBUG dbcounter [-] [82749] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=82749) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:34:10 devstack cinder-volume[82749]: DEBUG oslo_service.periodic_task [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82749) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:34:10 devstack cinder-volume[82749]: DEBUG cinder.volume.drivers.lvm [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Updating volume stats {{(pid=82749) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 12:34:10 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:34:10 devstack sudo[85588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:34:10 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:34:11 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root Jun 23 12:34:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:34:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:34:11 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:34:11 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:34:12 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Jun 23 12:34:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:34:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:34:12 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:34:12 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:34:12 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Jun 23 12:34:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.672s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:34:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:34:12 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:34:12 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:34:13 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Jun 23 12:34:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:34:13 devstack cinder-volume[82749]: DEBUG cinder.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Notifying Schedulers of capabilities ... {{(pid=82749) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:34:13 devstack cinder-volume[82749]: DEBUG oslo_service.periodic_task [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running periodic task VolumeManager._thread_info {{(pid=82749) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:34:13 devstack cinder-volume[82749]: DEBUG cinder.volume.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] thread count: 6 {{(pid=82749) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:34:13 devstack cinder-volume[82749]: DEBUG cinder.volume.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] thread info: [<_MainThread(MainThread, started 126749673844864)>, , , , , ] {{(pid=82749) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:35:10 devstack cinder-volume[82749]: DEBUG oslo_service.periodic_task [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82749) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:35:10 devstack cinder-volume[82749]: DEBUG cinder.volume.drivers.lvm [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Updating volume stats {{(pid=82749) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 12:35:10 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:35:10 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:35:10 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:35:11 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Jun 23 12:35:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:35:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:35:11 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:35:11 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:35:12 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Jun 23 12:35:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:35:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:35:12 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:35:12 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:35:12 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Jun 23 12:35:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:35:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:35:12 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:35:12 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:35:13 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Jun 23 12:35:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:35:13 devstack cinder-volume[82749]: DEBUG cinder.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Notifying Schedulers of capabilities ... {{(pid=82749) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:35:31 devstack cinder-volume[82749]: DEBUG dbcounter [-] [82749] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82749) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:36:10 devstack cinder-volume[82749]: DEBUG oslo_service.periodic_task [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82749) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:36:10 devstack cinder-volume[82749]: DEBUG cinder.volume.drivers.lvm [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Updating volume stats {{(pid=82749) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 12:36:10 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:36:10 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:36:10 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:36:11 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Jun 23 12:36:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:36:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:36:11 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:36:11 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:36:12 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Jun 23 12:36:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:36:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:36:12 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:36:12 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:36:12 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Jun 23 12:36:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:36:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:36:12 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:36:12 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:36:13 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Jun 23 12:36:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:36:13 devstack cinder-volume[82749]: DEBUG cinder.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Notifying Schedulers of capabilities ... {{(pid=82749) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:36:13 devstack cinder-volume[82749]: DEBUG oslo_service.periodic_task [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running periodic task VolumeManager._thread_info {{(pid=82749) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:36:13 devstack cinder-volume[82749]: DEBUG cinder.volume.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] thread count: 6 {{(pid=82749) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:36:13 devstack cinder-volume[82749]: DEBUG cinder.volume.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] thread info: [<_MainThread(MainThread, started 126749673844864)>, , , , , ] {{(pid=82749) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:37:10 devstack cinder-volume[82749]: DEBUG oslo_service.periodic_task [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82749) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:37:10 devstack cinder-volume[82749]: DEBUG cinder.volume.drivers.lvm [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Updating volume stats {{(pid=82749) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 12:37:10 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:37:10 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 12:37:10 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:37:11 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Jun 23 12:37:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:37:11 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:37:11 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:37:11 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:37:12 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Jun 23 12:37:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:37:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:37:12 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 12:37:12 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:37:12 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Jun 23 12:37:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:37:12 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:37:12 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 12:37:12 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:37:13 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Jun 23 12:37:13 devstack cinder-volume[82749]: DEBUG oslo_concurrency.processutils [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=82749) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:37:13 devstack cinder-volume[82749]: DEBUG cinder.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Notifying Schedulers of capabilities ... {{(pid=82749) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:37:13 devstack cinder-volume[82749]: DEBUG oslo_service.periodic_task [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] Running periodic task VolumeManager._thread_info {{(pid=82749) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:37:13 devstack cinder-volume[82749]: DEBUG cinder.volume.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] thread count: 6 {{(pid=82749) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:37:13 devstack cinder-volume[82749]: DEBUG cinder.volume.manager [None req-1909ed48-fa9c-4282-94aa-e18f3b6121e8 None None] thread info: [<_MainThread(MainThread, started 126749673844864)>, , , , , ] {{(pid=82749) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:37:31 devstack cinder-volume[82749]: DEBUG dbcounter [-] [82749] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82749) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:38:03 devstack cinder-volume[82573]: INFO oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Caught SIGTERM, stopping children Jun 23 12:38:03 devstack cinder-volume[82573]: DEBUG oslo_concurrency.lockutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Acquiring lock "singleton_lock" {{(pid=82573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 12:38:03 devstack cinder-volume[82573]: DEBUG oslo_concurrency.lockutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Acquired lock "singleton_lock" {{(pid=82573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 12:38:03 devstack cinder-volume[82573]: DEBUG oslo_concurrency.lockutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Releasing lock "singleton_lock" {{(pid=82573) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 12:38:03 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Stop services. {{(pid=82573) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 12:38:03 devstack cinder-volume[82573]: DEBUG oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Killing children. {{(pid=82573) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 12:38:03 devstack cinder-volume[82573]: INFO oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Waiting on 1 children to exit Jun 23 12:38:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.lockutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Acquiring lock "singleton_lock" {{(pid=82749) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 12:38:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.lockutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Acquired lock "singleton_lock" {{(pid=82749) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 12:38:04 devstack cinder-volume[82749]: DEBUG oslo_concurrency.lockutils [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Releasing lock "singleton_lock" {{(pid=82749) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 12:38:04 devstack cinder-volume[82749]: WARNING amqp [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 12:38:04 devstack cinder-volume[82749]: WARNING amqp [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 12:38:04 devstack cinder-volume[82573]: INFO oslo_service.backend._eventlet.service [None req-32ea77db-b81b-4c20-b654-716e802cd478 None None] Child 82749 exited with status 0 Jun 23 12:38:04 devstack cinder-volume[92843]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 12:38:04 devstack cinder-volume[92843]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 12:38:04 devstack cinder-volume[92843]: we strongly recommend against using it for new projects. Jun 23 12:38:04 devstack cinder-volume[92843]: If you are already using Eventlet, we recommend migrating to a different Jun 23 12:38:04 devstack cinder-volume[92843]: framework. For more detail see Jun 23 12:38:04 devstack cinder-volume[92843]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 12:38:04 devstack cinder-volume[92843]: import eventlet # noqa Jun 23 12:38:06 devstack cinder-volume[92843]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 12:38:06 devstack cinder-volume[92843]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 12:38:06 devstack cinder-volume[92843]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 12:38:07 devstack cinder-volume[92843]: INFO dbcounter [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Registered counter for database cinder Jun 23 12:38:07 devstack cinder-volume[92843]: DEBUG oslo_db.sqlalchemy.engines [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:07 devstack cinder-volume[92843]: DEBUG dbcounter [-] [92843] Writer thread running {{(pid=92843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 12:38:07 devstack cinder-volume[92843]: INFO cinder.rpc [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 12:38:07 devstack cinder-volume[92843]: INFO cinder.rpc [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 12:38:07 devstack cinder-volume[92843]: DEBUG oslo_db.sqlalchemy.engines [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:07 devstack cinder-volume[92843]: INFO cinder.volume.manager [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Determined volume DB was empty at startup. Jun 23 12:38:07 devstack cinder-volume[92843]: DEBUG cinder.volume.manager [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92843) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 12:38:07 devstack cinder-volume[92843]: INFO cinder.volume.manager [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 12:38:07 devstack cinder-volume[92843]: WARNING stevedore.named [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 12:38:07 devstack cinder-volume[92843]: WARNING castellan.key_manager [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 12:38:07 devstack cinder-volume[92843]: WARNING cinder.keymgr.conf_key_mgr [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 12:38:08 devstack cinder-volume[92843]: INFO cinder.volume.manager [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_db.sqlalchemy.engines [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92843) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:08 devstack cinder-volume[92843]: INFO oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Starting 1 workers Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Started child 93060 {{(pid=92843) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Full set of CONF: {{(pid=92843) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] ******************************************************************************** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Configuration options gathered from: {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] ================================================================================ {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] allow_availability_zone_fallback = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] allow_compression_on_image_upload = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] allowed_direct_url_schemes = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[93060]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] api_rate_limit = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] auth_strategy = keystone {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_availability_zone = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_host = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_stats_polling_interval = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backup_api_class = cinder.backup.api.API {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backup_name_template = backup-%s {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backup_use_same_host = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backup_use_temp_snapshot = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] chap_password = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] chap_username = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_internal_tenant_project_id = a4a779c9710d46289ad302c996b7d627 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_internal_tenant_user_id = 949a37a24de54c7a90e00f304ad63bf9 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cluster = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] compression_format = gzip {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] compute_api_class = cinder.compute.nova.API {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] config_dir = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] config_source = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] control_exchange = openstack {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] debug = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] default_availability_zone = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] default_group_type = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] default_volume_type = QuobyteHD {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] disk_geometry = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] driver_client_cert = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] driver_client_cert_key = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] driver_data_namespace = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] driver_ssl_cert_path = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] driver_ssl_cert_verify = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] driver_use_ssl = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] enable_new_services = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] enable_unsupported_driver = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] enabled_backends = ['QuobyteHD'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] enforce_multipath_for_image_xfer = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] filter_function = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_api_insecure = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_api_ssl_compression = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_ca_certificates_file = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_catalog_info = image:glance:publicURL {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_num_retries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance_request_timeout = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] goodness_function = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] graceful_shutdown_timeout = 5 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] group_api_class = cinder.group.api.API {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] host = devstack {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_compress_on_upload = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_conversion_address_space_limit = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_conversion_cpu_limit = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_conversion_disable = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_upload_use_cinder_backend = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_upload_use_internal_tenant = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_volume_cache_enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_volume_cache_max_count = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] image_volume_cache_max_size_gb = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] init_host_max_objects_retrieval = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] instance_format = [instance: %(uuid)s] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] iscsi_target_flags = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] iscsi_write_cache = on {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] iser_helper = tgtadm {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[93060]: INFO cinder.volume.manager [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.remotefs [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93060) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] iser_ip_address = 192.168.122.34 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] iser_port = 3260 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_color = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_config_append = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_dir = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_file = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_options = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_rotate_interval = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_rotate_interval_type = days {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] log_rotation_type = none {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] max_age = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] max_logfile_count = 30 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] max_logfile_size_mb = 200 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] max_over_subscription_ratio = 20.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] message_reap_interval = 86400 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] message_ttl = 2592000 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] migration_create_volume_timeout_secs = 300 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] monkey_patch = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] monkey_patch_modules = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] my_ip = 192.168.122.34 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] no_snapshot_gb_quota = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] num_iser_scan_tries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] num_shell_tries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] num_volume_device_scan_tries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] nvmeof_conn_info_version = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] nvmet_ns_id = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] nvmet_port_id = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] osapi_max_limit = 1000 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] osapi_volume_ext_list = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] osapi_volume_listen_port = 8776 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] osapi_volume_use_ssl = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] osapi_volume_workers = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] per_volume_size_limit = -1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] periodic_fuzzy_delay = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] periodic_interval = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] public_endpoint = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] publish_errors = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] quota_backup_gigabytes = 1000 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] quota_backups = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] quota_gigabytes = 1000 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] quota_groups = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] quota_snapshots = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] quota_volumes = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] rate_limit_burst = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] rate_limit_except_level = CRITICAL {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] rate_limit_interval = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] reinit_driver_count = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] replication_device = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] report_discard_supported = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] report_interval = 120 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] reservation_clean_interval = 86400 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] reservation_expire = 86400 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] reserved_image_namespaces = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] reserved_percentage = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] rpc_response_timeout = 120 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] run_external_periodic_tasks = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] scst_target_driver = iscsi {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] scst_target_iqn_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_down_time = 720 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] shell_completion = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] snapshot_name_template = snapshot-%s {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] split_loggers = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] state_path = /opt/stack/data/cinder {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] storage_availability_zone = nova {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] storage_protocol = iSCSI {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] syslog_log_facility = LOG_USER {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] target_helper = lioadm {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] target_ip_address = 192.168.122.34 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] target_port = 3260 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] target_protocol = iscsi {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] target_secondary_ip_addresses = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] trace_flags = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] transport_url = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] until_refresh = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] use_chap_auth = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] use_default_quota_class = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] use_journal = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] use_json = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] use_multipath_for_image_xfer = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] use_stderr = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] use_syslog = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] verify_glance_signatures = enabled {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_api_class = cinder.volume.api.API {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_backend_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_clear = zero {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_clear_ionice = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_clear_size = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_copy_bps_limit = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_dd_blocksize = 1M {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_name_template = volume-%s {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_service_inithost_offload = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volume_usage_audit_period = month {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] zoning_mode = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_concurrency.disable_process_locking = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.auth_section = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.auth_type = password {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.auth_version = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.cache = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.include_service_catalog = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.insecure = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.interface = public {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_password = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcache_username = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.region_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.service_type = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.backend = dogpile.cache.null {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.backend_argument = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.backend_expiration_time = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.config_prefix = cache.oslo {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.debug_cache_backend = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.enable_retry_client = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.enable_socket_keepalive = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.expiration_time = 600 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.hashclient_retry_attempts = 2 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.memcache_dead_retry = 300 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.memcache_pool_maxsize = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.memcache_sasl_enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.password = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.proxies = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.redis_db = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.redis_server = localhost:6379 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.retry_attempts = 2 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.retry_delay = 0.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.socket_keepalive_count = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.socket_keepalive_idle = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.socket_keepalive_interval = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.socket_timeout = 1.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.tls_allowed_ciphers = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.tls_cafile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.tls_certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.tls_enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.tls_keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cache.username = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] coordination.backend_url = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.asyncio_connection = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.asyncio_slave_connection = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.backend = sqlalchemy {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.connection = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.connection_debug = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.connection_parameters = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.connection_recycle_time = 3600 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.connection_trace = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.db_inc_retry_interval = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.db_max_retries = 20 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.db_max_retry_interval = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.db_retry_interval = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.max_overflow = 50 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.max_pool_size = 5 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.max_retries = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93060) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 12:38:08 devstack cinder-volume[93060]: WARNING cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.mysql_wsrep_sync_wait = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.pool_timeout = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.retry_interval = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.slave_connection = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.sqlite_synchronous = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.synchronous_reader = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] database.use_db_reconnect = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[93060]: WARNING cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Running cmd (subprocess): mount.quobyte {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.connection_string = messaging:// {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.es_doc_type = notification {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.es_scroll_size = 10000 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.es_scroll_time = 2m {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.filter_error_trace = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.hmac_keys = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.sentinel_service_name = mymaster {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.socket_timeout = 0.1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.trace_requests = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler.trace_sqlalchemy = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler_jaeger.process_tags = {} {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler_jaeger.service_name_prefix = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] profiler_otlp.service_name_prefix = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.enforce_new_defaults = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: WARNING oslo_config.cfg [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.enforce_scope = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.policy_default_rule = default {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.policy_file = policy.yaml {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] privsep_osbrick.group = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] privsep_osbrick.helper_command = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] privsep_osbrick.user = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_sys_admin.group = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_sys_admin.helper_command = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] cinder_sys_admin.user = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.auth_section = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.auth_type = password {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.cafile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.collect_timing = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.insecure = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.send_service_user_token = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.split_loggers = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] service_user.timeout = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.auth_section = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.auth_type = password {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.collect_timing = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.insecure = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.region_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.split_loggers = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] glance.timeout = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.backend_availability_zone = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.chap_password = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.chap_username = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.disk_geometry = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.driver_client_cert = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.driver_client_cert_key = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.driver_data_namespace = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.driver_use_ssl = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.extra_capabilities = {} {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.filter_function = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.goodness_function = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.iscsi_target_flags = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.iscsi_write_cache = on {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.iser_helper = tgtadm {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.iser_port = 3260 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_host = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_login = admin {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_mount_options = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_password = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_private_key = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_share_path = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.num_shell_tries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.quobyte_volume_url = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.replication_device = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.report_discard_supported = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.reserved_percentage = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.target_helper = tgtadm {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.target_port = 3260 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.target_protocol = iscsi {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.trace_flags = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.unique_fqdn_network = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.use_chap_auth = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_backend_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_clear = zero {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_clear_ionice = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_clear_size = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_reports.file_event_handler = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_reports.log_dir = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.backend_availability_zone = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.backend_host = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.chap_password = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.chap_username = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.chiscsi_conf = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.disk_geometry = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.driver_client_cert = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.driver_data_namespace = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.driver_use_ssl = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.extra_capabilities = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.filter_function = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.goodness_function = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.iser_helper = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.iser_ip_address = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.iser_port = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.iser_target_prefix = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_host = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_login = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_mount_options = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_password = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_private_key = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_share_path = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_ssh_port = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.num_shell_tries = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.nvmet_port_id = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.replication_device = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.report_discard_supported = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.reserved_percentage = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.scst_target_driver = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.storage_protocol = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.target_helper = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.target_ip_address = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.target_port = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.target_prefix = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.target_protocol = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.trace_flags = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.use_chap_auth = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_clear = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_clear_size = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] QuobyteHD.volumes_dir = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack quobyte-client[93061]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack quobyte-client[93061]: Invalid parameters found, error: missing mount point. Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack quobyte-client[93061]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 12:38:08 devstack quobyte-client[93061]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] CMD "mount.quobyte" returned: 1 in 0.157s {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[93060]: INFO cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 ... Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 -c /etc/quobyte/client-cinder.cfg {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.ssl = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_notifications.driver = [] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_notifications.retry = -1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] key_manager.fixed_key = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.barbican_api_version = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.barbican_endpoint = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.barbican_endpoint_type = public {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.barbican_region_name = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.cafile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.collect_timing = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.insecure = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.number_of_retries = 60 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.retry_delay = 1 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.send_service_user_token = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.split_loggers = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.timeout = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 -c /etc/quobyte/client-cinder.cfg Jun 23 12:38:08 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.verify_ssl = True {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican.verify_ssl_path = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.auth_section = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.auth_type = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.cafile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.certfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.collect_timing = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.insecure = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.keyfile = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.split_loggers = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] barbican_service_user.timeout = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.approle_role_id = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.approle_secret_id = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.kv_mountpoint = secret {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.kv_path = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.kv_version = 2 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.namespace = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.root_token_id = **** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.ssl_ca_crt_file = None {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.timeout = 60.0 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.use_ssl = False {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:08 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] ******************************************************************************** {{(pid=92843) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 12:38:09 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:09 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.777s {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:09 devstack cinder-volume[93060]: INFO cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 succeeded Jun 23 12:38:09 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:38:09 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.789s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:38:09 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:09 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:38:09 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:09 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:09 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.646s {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:09 devstack cinder-volume[93060]: INFO cinder.volume.driver [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Driver hasn't implemented _init_vendor_properties() Jun 23 12:38:09 devstack cinder-volume[93060]: DEBUG cinder.volume.driver [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864738464355, 'free_capacity_gb': 1775.6864738464355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93060) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_db.sqlalchemy.engines [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG dbcounter [-] [93060] Writer thread running {{(pid=93060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.db.api [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Building query based on filter {{(pid=93060) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.image.image_utils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93060) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 12:38:10 devstack cinder-volume[93060]: INFO cinder.keymgr.migration [None req-31755829-ee71-48f5-b6b7-b002ae8ae6b7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:10 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:38:10 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:10 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.617s {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.manager [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Notifying Schedulers of capabilities ... {{(pid=93060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:38:10 devstack cinder-volume[93060]: INFO cinder.volume.manager [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Driver initialization completed successfully. Jun 23 12:38:10 devstack cinder-volume[93060]: INFO cinder.manager [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Initiating service 3 cleanup Jun 23 12:38:10 devstack cinder-volume[93060]: INFO cinder.manager [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Service 3 cleanup completed. Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.service [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Creating RPC server for service cinder-volume {{(pid=93060) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.service [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93060) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 12:38:10 devstack cinder-volume[93060]: INFO cinder.volume.manager [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:38:10 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:10 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:38:10 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:11 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:11 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.672s {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:11 devstack cinder-volume[93060]: INFO cinder.volume.manager [None req-84ce42ba-af3e-44f5-b72f-a139c30c979a None None] Driver post RPC initialization completed successfully. Jun 23 12:38:15 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:38:15 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:38:15 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:38:15 devstack cinder-volume[93060]: DEBUG cinder.volume.drivers.quobyte [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:38:15 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:38:15 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:15 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:38:15 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:16 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:16 devstack cinder-volume[93060]: DEBUG oslo_concurrency.processutils [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.583s {{(pid=93060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:16 devstack cinder-volume[93060]: DEBUG cinder.manager [None req-c67ffe57-c367-405e-b4d6-349faaefcf96 None None] Notifying Schedulers of capabilities ... {{(pid=93060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:38:18 devstack cinder-volume[92843]: DEBUG dbcounter [-] [92843] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92843) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:38:18 devstack cinder-volume[92843]: INFO oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Caught SIGTERM, stopping children Jun 23 12:38:18 devstack cinder-volume[92843]: DEBUG oslo_concurrency.lockutils [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Acquiring lock "singleton_lock" {{(pid=92843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 12:38:18 devstack cinder-volume[92843]: DEBUG oslo_concurrency.lockutils [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Acquired lock "singleton_lock" {{(pid=92843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 12:38:18 devstack cinder-volume[92843]: DEBUG oslo_concurrency.lockutils [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Releasing lock "singleton_lock" {{(pid=92843) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 12:38:18 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Stop services. {{(pid=92843) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 12:38:18 devstack cinder-volume[92843]: DEBUG oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Killing children. {{(pid=92843) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 12:38:18 devstack cinder-volume[92843]: INFO oslo_service.backend._eventlet.service [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Waiting on 1 children to exit Jun 23 12:38:20 devstack cinder-volume[93060]: DEBUG dbcounter [-] [93060] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:38:21 devstack cinder-volume[93060]: DEBUG dbcounter [-] [93060] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=93060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:38:23 devstack cinder-volume[93060]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 23 12:38:24 devstack cinder-volume[93352]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 12:38:24 devstack cinder-volume[93352]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 12:38:24 devstack cinder-volume[93352]: we strongly recommend against using it for new projects. Jun 23 12:38:24 devstack cinder-volume[93352]: If you are already using Eventlet, we recommend migrating to a different Jun 23 12:38:24 devstack cinder-volume[93352]: framework. For more detail see Jun 23 12:38:24 devstack cinder-volume[93352]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 12:38:24 devstack cinder-volume[93352]: import eventlet # noqa Jun 23 12:38:24 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Acquiring lock "singleton_lock" {{(pid=93060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 12:38:24 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Acquired lock "singleton_lock" {{(pid=93060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 12:38:24 devstack cinder-volume[93060]: DEBUG oslo_concurrency.lockutils [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Releasing lock "singleton_lock" {{(pid=93060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 12:38:24 devstack cinder-volume[93060]: WARNING amqp [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 12:38:24 devstack cinder-volume[93060]: WARNING amqp [None req-3a18a07c-797c-4111-a572-a13bd79fd7a4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 12:38:26 devstack cinder-volume[93352]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 12:38:26 devstack cinder-volume[93352]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 12:38:26 devstack cinder-volume[93352]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 12:38:27 devstack cinder-volume[93352]: INFO dbcounter [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Registered counter for database cinder Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_db.sqlalchemy.engines [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG dbcounter [-] [93352] Writer thread running {{(pid=93352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 12:38:27 devstack cinder-volume[93352]: INFO cinder.rpc [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 12:38:27 devstack cinder-volume[93352]: INFO cinder.rpc [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_db.sqlalchemy.engines [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:27 devstack cinder-volume[93352]: INFO cinder.volume.manager [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Determined volume DB was empty at startup. Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG cinder.volume.manager [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93352) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 12:38:27 devstack cinder-volume[93352]: WARNING stevedore.named [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 12:38:27 devstack cinder-volume[93352]: WARNING castellan.key_manager [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 12:38:27 devstack cinder-volume[93352]: WARNING cinder.keymgr.conf_key_mgr [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 12:38:27 devstack cinder-volume[93352]: INFO cinder.volume.manager [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_db.sqlalchemy.engines [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:27 devstack cinder-volume[93352]: INFO oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Starting 1 workers Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Started child 93659 {{(pid=93352) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Full set of CONF: {{(pid=93352) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] ******************************************************************************** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Configuration options gathered from: {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] ================================================================================ {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] allow_availability_zone_fallback = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] allow_compression_on_image_upload = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] allowed_direct_url_schemes = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] api_rate_limit = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] auth_strategy = keystone {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_availability_zone = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_host = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_stats_polling_interval = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backup_api_class = cinder.backup.api.API {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backup_name_template = backup-%s {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backup_use_same_host = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backup_use_temp_snapshot = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] chap_password = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] chap_username = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_internal_tenant_project_id = a4a779c9710d46289ad302c996b7d627 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_internal_tenant_user_id = 949a37a24de54c7a90e00f304ad63bf9 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cluster = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] compression_format = gzip {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93659]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] compute_api_class = cinder.compute.nova.API {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] config_dir = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] config_source = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] control_exchange = openstack {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] debug = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] default_availability_zone = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] default_group_type = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] default_volume_type = QuobyteHD {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] disk_geometry = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] driver_client_cert = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] driver_client_cert_key = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] driver_data_namespace = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] driver_ssl_cert_path = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] driver_ssl_cert_verify = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] driver_use_ssl = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] enable_new_services = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] enable_unsupported_driver = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] enabled_backends = ['QuobyteHD'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] enforce_multipath_for_image_xfer = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] filter_function = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_api_insecure = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_api_servers = ['http://192.168.122.34/image'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_api_ssl_compression = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_ca_certificates_file = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_catalog_info = image:glance:publicURL {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_num_retries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance_request_timeout = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] goodness_function = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] graceful_shutdown_timeout = 5 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] group_api_class = cinder.group.api.API {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] host = devstack {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_compress_on_upload = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_conversion_address_space_limit = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_conversion_cpu_limit = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_conversion_disable = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_upload_use_cinder_backend = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_upload_use_internal_tenant = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_volume_cache_enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_volume_cache_max_count = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] image_volume_cache_max_size_gb = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] init_host_max_objects_retrieval = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] instance_format = [instance: %(uuid)s] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] iscsi_target_flags = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] iscsi_write_cache = on {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] iser_helper = tgtadm {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] iser_ip_address = 192.168.122.34 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] iser_port = 3260 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_color = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_config_append = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_dir = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_file = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_options = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_rotate_interval = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_rotate_interval_type = days {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] log_rotation_type = none {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] max_age = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] max_logfile_count = 30 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] max_logfile_size_mb = 200 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] max_over_subscription_ratio = 20.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] message_reap_interval = 86400 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] message_ttl = 2592000 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] migration_create_volume_timeout_secs = 300 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] monkey_patch = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] monkey_patch_modules = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] my_ip = 192.168.122.34 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] no_snapshot_gb_quota = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] num_iser_scan_tries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] num_shell_tries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] num_volume_device_scan_tries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] nvmeof_conn_info_version = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] nvmet_ns_id = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] nvmet_port_id = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] osapi_max_limit = 1000 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] osapi_volume_ext_list = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] osapi_volume_listen_port = 8776 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] osapi_volume_use_ssl = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] osapi_volume_workers = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] per_volume_size_limit = -1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] periodic_fuzzy_delay = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] periodic_interval = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] public_endpoint = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] publish_errors = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] quota_backup_gigabytes = 1000 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] quota_backups = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] quota_gigabytes = 1000 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] quota_groups = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] quota_snapshots = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] quota_volumes = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] rate_limit_burst = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] rate_limit_except_level = CRITICAL {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] rate_limit_interval = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] reinit_driver_count = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] replication_device = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] report_discard_supported = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] report_interval = 120 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] reservation_clean_interval = 86400 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] reservation_expire = 86400 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] reserved_image_namespaces = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] reserved_percentage = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] rpc_response_timeout = 120 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] run_external_periodic_tasks = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] scst_target_driver = iscsi {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] scst_target_iqn_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_down_time = 720 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] shell_completion = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] snapshot_name_template = snapshot-%s {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] split_loggers = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] state_path = /opt/stack/data/cinder {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93659) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] storage_availability_zone = nova {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] storage_protocol = iSCSI {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] syslog_log_facility = LOG_USER {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] target_helper = lioadm {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] target_ip_address = 192.168.122.34 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] target_port = 3260 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] target_protocol = iscsi {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] target_secondary_ip_addresses = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] trace_flags = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] transport_url = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] until_refresh = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] use_chap_auth = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] use_default_quota_class = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] use_journal = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] use_json = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] use_multipath_for_image_xfer = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] use_stderr = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] use_syslog = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] verify_glance_signatures = enabled {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_api_class = cinder.volume.api.API {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_backend_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_clear = zero {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_clear_ionice = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_clear_size = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_copy_bps_limit = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_dd_blocksize = 1M {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_name_template = volume-%s {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_service_inithost_offload = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volume_usage_audit_period = month {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] zoning_mode = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_concurrency.disable_process_locking = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.auth_section = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.auth_type = password {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.auth_version = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.cache = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.include_service_catalog = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.insecure = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.interface = public {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_password = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcache_username = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.region_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.service_type = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.34/identity {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.backend = dogpile.cache.null {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.backend_argument = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.backend_expiration_time = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.config_prefix = cache.oslo {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.debug_cache_backend = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.enable_retry_client = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.enable_socket_keepalive = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.expiration_time = 600 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.hashclient_retry_attempts = 2 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.memcache_dead_retry = 300 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.memcache_pool_maxsize = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.memcache_sasl_enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.password = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.proxies = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.redis_db = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.redis_server = localhost:6379 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.retry_attempts = 2 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.retry_delay = 0.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.socket_keepalive_count = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.socket_keepalive_idle = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.socket_keepalive_interval = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.socket_timeout = 1.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.tls_allowed_ciphers = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.tls_cafile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.tls_certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.tls_enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.tls_keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cache.username = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] coordination.backend_url = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.asyncio_connection = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.asyncio_slave_connection = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.backend = sqlalchemy {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.connection = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.connection_debug = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.connection_parameters = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.connection_recycle_time = 3600 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.connection_trace = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.db_inc_retry_interval = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.db_max_retries = 20 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.db_max_retry_interval = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.db_retry_interval = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.max_overflow = 50 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.max_pool_size = 5 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.max_retries = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.mysql_wsrep_sync_wait = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.pool_timeout = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.retry_interval = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.slave_connection = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.sqlite_synchronous = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.synchronous_reader = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] database.use_db_reconnect = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.connection_string = messaging:// {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.es_doc_type = notification {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.es_scroll_size = 10000 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.es_scroll_time = 2m {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.filter_error_trace = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.hmac_keys = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.sentinel_service_name = mymaster {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.socket_timeout = 0.1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.trace_requests = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler.trace_sqlalchemy = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler_jaeger.process_tags = {} {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler_jaeger.service_name_prefix = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] profiler_otlp.service_name_prefix = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.enforce_new_defaults = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: WARNING oslo_config.cfg [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.enforce_scope = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.policy_default_rule = default {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.policy_file = policy.yaml {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] privsep_osbrick.group = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] privsep_osbrick.helper_command = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] privsep_osbrick.user = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_sys_admin.group = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_sys_admin.helper_command = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] cinder_sys_admin.user = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.auth_section = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.auth_type = password {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.cafile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.collect_timing = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.insecure = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.send_service_user_token = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.split_loggers = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] service_user.timeout = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.auth_section = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.auth_type = password {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.collect_timing = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.insecure = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.region_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.split_loggers = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] glance.timeout = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.backend_availability_zone = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.chap_password = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.chap_username = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.disk_geometry = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.driver_client_cert = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.driver_client_cert_key = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.driver_data_namespace = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.driver_use_ssl = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.extra_capabilities = {} {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.filter_function = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.goodness_function = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.iscsi_target_flags = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.iscsi_write_cache = on {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.iser_helper = tgtadm {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.iser_ip_address = 192.168.122.34 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.iser_port = 3260 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_host = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_login = admin {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_mount_options = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_password = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_private_key = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_share_path = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93659) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.num_shell_tries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Running cmd (subprocess): mount.quobyte {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.quobyte_volume_url = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.replication_device = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.report_discard_supported = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.reserved_percentage = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.target_helper = tgtadm {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.target_ip_address = 192.168.122.34 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.target_port = 3260 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.target_protocol = iscsi {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.trace_flags = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.unique_fqdn_network = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.use_chap_auth = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_backend_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_clear = zero {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:27 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_clear_ionice = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_clear_size = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_reports.file_event_handler = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_reports.log_dir = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.backend_availability_zone = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.backend_host = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.chap_password = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.chap_username = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.chiscsi_conf = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.disk_geometry = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.driver_client_cert = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.driver_data_namespace = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.driver_use_ssl = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.extra_capabilities = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.filter_function = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.goodness_function = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.iser_helper = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.iser_ip_address = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.iser_port = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.iser_target_prefix = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_host = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_login = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_mount_options = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_password = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_private_key = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_share_path = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_ssh_port = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.num_shell_tries = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.nvmet_port_id = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.replication_device = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.report_discard_supported = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.reserved_percentage = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.scst_target_driver = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.storage_protocol = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.target_helper = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.target_ip_address = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.target_port = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.target_prefix = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.target_protocol = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.trace_flags = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.use_chap_auth = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_clear = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_clear_size = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] QuobyteHD.volumes_dir = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.ssl = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_notifications.driver = [] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_notifications.retry = -1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] key_manager.fixed_key = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.barbican_api_version = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.barbican_endpoint = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.barbican_endpoint_type = public {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.barbican_region_name = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.cafile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.collect_timing = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.insecure = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.number_of_retries = 60 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.retry_delay = 1 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.send_service_user_token = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.split_loggers = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.timeout = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.verify_ssl = True {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican.verify_ssl_path = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.auth_section = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.auth_type = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.cafile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.certfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.collect_timing = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.insecure = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.keyfile = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.split_loggers = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] barbican_service_user.timeout = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack quobyte-client[93660]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.approle_role_id = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.approle_secret_id = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.kv_mountpoint = secret {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack quobyte-client[93660]: Invalid parameters found, error: missing mount point. Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.kv_path = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.kv_version = 2 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.namespace = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.root_token_id = **** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.ssl_ca_crt_file = None {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack quobyte-client[93660]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.timeout = 60.0 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.use_ssl = False {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 12:38:28 devstack cinder-volume[93352]: DEBUG oslo_service.backend._eventlet.service [None req-17d4a79a-b19d-472e-b915-0c3736be2325 None None] ******************************************************************************** {{(pid=93352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 12:38:28 devstack quobyte-client[93660]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:28 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:38:28 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:28 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.616s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:28 devstack cinder-volume[93659]: INFO cinder.volume.driver [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Driver hasn't implemented _init_vendor_properties() Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG cinder.volume.driver [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864738464355, 'free_capacity_gb': 1775.6864738464355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93659) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_db.sqlalchemy.engines [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93659) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writer thread running {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG cinder.db.api [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Building query based on filter {{(pid=93659) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93659) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:38:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:28 devstack cinder-volume[93659]: INFO cinder.keymgr.migration [None req-cbab9a58-07dd-492c-8783-453c72a38db4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 12:38:28 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:38:28 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:29 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.605s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:38:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Driver initialization completed successfully. Jun 23 12:38:29 devstack cinder-volume[93659]: INFO cinder.manager [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Initiating service 3 cleanup Jun 23 12:38:29 devstack cinder-volume[93659]: INFO cinder.manager [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Service 3 cleanup completed. Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG cinder.service [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Creating RPC server for service cinder-volume {{(pid=93659) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG cinder.service [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93659) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 12:38:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:38:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:38:29 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:38:29 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:38:30 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Jun 23 12:38:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.588s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:38:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d716b44d-a744-4559-8c11-42c1e83a574e None None] Driver post RPC initialization completed successfully. Jun 23 12:38:37 devstack cinder-volume[93352]: DEBUG dbcounter [-] [93352] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:38:38 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:38:40 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=4 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:39:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:39:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 6 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:39:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Flow 'volume_create_manager' (fdac517a-fd19-4f09-91de-00f47da048bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc65a0f-4157-4db1-8489-5372dc2fcea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc65a0f-4157-4db1-8489-5372dc2fcea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1234062312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5680673-d928-49bb-876c-55fd2d229c17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a7c2ca9cc7946eeac9ecd9b0ed6037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:28Z,use_quota=True,user_id='63490a88e89c4d66b36a1ccfb8381f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9177c296-b5b3-4fb2-8650-bdbb55d7226b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9177c296-b5b3-4fb2-8650-bdbb55d7226b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff483b0a-0327-478e-b02e-2185ed23ab20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff483b0a-0327-478e-b02e-2185ed23ab20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5680673-d928-49bb-876c-55fd2d229c17', 'volume_name': 'volume-e5680673-d928-49bb-876c-55fd2d229c17', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eca517-8c10-4876-941b-27796be4ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25eca517-8c10-4876-941b-27796be4ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe8c985-b0e5-4928-99bf-ca1fefb448de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:28 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Volume e5680673-d928-49bb-876c-55fd2d229c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5680673-d928-49bb-876c-55fd2d229c17', 'volume_size': 1} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1234062312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5680673-d928-49bb-876c-55fd2d229c17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a7c2ca9cc7946eeac9ecd9b0ed6037b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:28Z,use_quota=True,user_id='63490a88e89c4d66b36a1ccfb8381f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Creating volume e5680673-d928-49bb-876c-55fd2d229c17 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:39:28 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:39:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:28 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 1073741824 Jun 23 12:39:28 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:29 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 1073741824" returned: 0 in 1.643s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:30 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 Jun 23 12:39:30 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:31 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17" returned: 0 in 1.494s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] <== create_volume: return (3236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.239s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe8c985-b0e5-4928-99bf-ca1fefb448de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5680673-d928-49bb-876c-55fd2d229c17', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08cae79-5c25-4d29-892e-85629e7a8cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:31 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Volume volume-e5680673-d928-49bb-876c-55fd2d229c17 (e5680673-d928-49bb-876c-55fd2d229c17): created successfully Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08cae79-5c25-4d29-892e-85629e7a8cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Flow 'volume_create_manager' (fdac517a-fd19-4f09-91de-00f47da048bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-aec21411-267d-4122-bde0-852d56107179 req-5ed92ea0-a62c-44ba-9e11-774c758cac57 tempest-VolumesGetTestJSON-1031030404 None] Created volume successfully. Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Flow 'volume_create_manager' (918a1eca-09dc-4fb5-b1dc-b8ca135d4d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd7ce61-6c34-42b7-bc02-e1c95b8dc705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd7ce61-6c34-42b7-bc02-e1c95b8dc705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-467885262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ed9a80ff994b71a1ed5b5362cfca18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:32Z,use_quota=True,user_id='db5c0ffdc68d44d583a963326b7702a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4deb4d56-882b-4ab4-ba34-bd57c92b60f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4deb4d56-882b-4ab4-ba34-bd57c92b60f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbb8b1a-ec40-49b3-91dd-9483c77206de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbb8b1a-ec40-49b3-91dd-9483c77206de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9', 'volume_name': 'volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aca57e7-481a-4b88-8800-3f6b1048aed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aca57e7-481a-4b88-8800-3f6b1048aed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60919ed8-0394-4c6d-8470-2820782afa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:31 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Volume 0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9', 'volume_size': 1} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-467885262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ed9a80ff994b71a1ed5b5362cfca18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:32Z,use_quota=True,user_id='db5c0ffdc68d44d583a963326b7702a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Creating volume 0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:39:31 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:39:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:32 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 1073741824 Jun 23 12:39:32 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Acquiring lock "cinder-e5680673-d928-49bb-876c-55fd2d229c17-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:39:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Lock "cinder-e5680673-d928-49bb-876c-55fd2d229c17-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:39:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Acquiring lock "cinder-quobyte-e5680673-d928-49bb-876c-55fd2d229c17" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:39:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Lock "cinder-quobyte-e5680673-d928-49bb-876c-55fd2d229c17" acquired by "delete_volume" :: waited 0.075s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:39:32 devstack cinder-volume[93659]: INFO oslo.privsep.daemon [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm6bt55ry/privsep.sock'] Jun 23 12:39:32 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm6bt55ry/privsep.sock Jun 23 12:39:32 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 12:39:33 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:33 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 23 12:39:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 1073741824" returned: 0 in 1.956s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:34 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 Jun 23 12:39:34 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 12:39:35 devstack cinder-volume[93659]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 23 12:39:35 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9" returned: 0 in 1.343s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] <== create_volume: return (3381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.384s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60919ed8-0394-4c6d-8470-2820782afa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbc315a-8978-4db2-a6f4-369eb04d0aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:35 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Volume volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 (0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9): created successfully Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbc315a-8978-4db2-a6f4-369eb04d0aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Flow 'volume_create_manager' (918a1eca-09dc-4fb5-b1dc-b8ca135d4d84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-414e537e-1e6c-4b8a-9539-53f71896b42f tempest-DeleteServersTestJSON-1057827244 None] Created volume successfully. Jun 23 12:39:35 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:35 devstack cinder-volume[93659]: INFO oslo.privsep.daemon [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Spawned new privsep daemon via rootwrap Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Accepted privsep connection to /tmp/tmpm6bt55ry/privsep.sock {{(pid=93659) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 23 12:39:35 devstack cinder-volume[93659]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 23 12:39:35 devstack cinder-volume[93659]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 23 12:39:35 devstack cinder-volume[93659]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 23 12:39:35 devstack cinder-volume[93659]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94730 Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944ee16-b28c-4fe4-bd4e-3c4a09796423]: (2,) {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cc308b-994c-4a49-ab5d-76f162290749]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:39:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:35 devstack sudo[94732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 Jun 23 12:39:35 devstack sudo[94732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:36 devstack sudo[94732]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17" returned: 0 in 0.981s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:36 devstack sudo[94745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17 Jun 23 12:39:36 devstack sudo[94745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:37 devstack sudo[94745]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e5680673-d928-49bb-876c-55fd2d229c17" returned: 0 in 0.736s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Lock "cinder-quobyte-e5680673-d928-49bb-876c-55fd2d229c17" released by "delete_volume" :: held 4.719s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:39:37 devstack cinder-volume[93659]: WARNING cinder.quota [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:39:37 devstack cinder-volume[93659]: WARNING cinder.quota [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG cinder.quota [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Created reservations ['29ef8516-6cfc-4394-8370-9b5e20172c11', 'de032307-499c-402b-848f-6212acfa1af2', '9f40978e-6913-4cf7-a020-3d840a212230', '0a2fa8bc-fd96-4898-902f-8372f733fbf6'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:37 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:39:37 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:38 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.072s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:38 devstack cinder-volume[93659]: DEBUG cinder.manager [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:39:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Deleted volume successfully. Jun 23 12:39:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-461f7271-6d75-4140-a9b4-71bfb66fefd2 req-04bc8cf1-f09c-422b-bebe-69a3b3b22535 tempest-VolumesGetTestJSON-1031030404 None] Lock "cinder-e5680673-d928-49bb-876c-55fd2d229c17-delete_volume" released by "delete_volume" :: held 6.256s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:39:43 devstack cinder-volume[93659]: WARNING py.warnings [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 23 12:39:43 devstack cinder-volume[93659]: .first() Jun 23 12:39:43 devstack cinder-volume[93659]: Jun 23 12:39:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:43 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c6ce0c-bf38-4867-b5b9-f4b626c098f7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:39:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:43 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 Jun 23 12:39:43 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:44 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9" returned: 0 in 1.013s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.036s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8871daf-a625-4f11-82e4-fa975ef7a3fc', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:39:44 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-a61eebbc-2566-452a-b662-0df92dc971d8 req-1e993596-1606-4e38-bfc3-678b221ffb80 tempest-DeleteServersTestJSON-1057827244 None] attachment_update completed successfully. Jun 23 12:39:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-893a05af-478c-4529-9430-5ffd31711606 tempest-GroupSnapshotsV319Test-500130977 None] Group tempest-GroupSnapshotsV319Test-Group-1399850182: creating Jun 23 12:39:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-893a05af-478c-4529-9430-5ffd31711606 tempest-GroupSnapshotsV319Test-500130977 None] Group tempest-GroupSnapshotsV319Test-Group-1399850182: created successfully Jun 23 12:39:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-893a05af-478c-4529-9430-5ffd31711606 tempest-GroupSnapshotsV319Test-500130977 None] Create group completed successfully. Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Flow 'volume_create_manager' (6355af9d-c586-46a2-bbf4-941e2e13753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f460206c-60bc-4c13-9fd2-a18afc29f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f460206c-60bc-4c13-9fd2-a18afc29f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102661184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63955780-0969-4ef7-a2d6-d8e3d577288e,host='devstack@QuobyteHD#QuobyteHD',id=b376a82c-c857-4bdc-b65c-0aa43bb4f540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3649f6ebeb214aa39428de774dd7b409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:48Z,use_quota=True,user_id='5e9978ce7cea425c9c64e16a846b0cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7961f2a3-63d7-487f-8840-bfefc6ff651f),volume_type_id=7961f2a3-63d7-487f-8840-bfefc6ff651f)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843ae9a-2e8e-4f37-8470-fa21b55ecfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6843ae9a-2e8e-4f37-8470-fa21b55ecfae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20648787-4531-41b5-bc43-0691f2713fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20648787-4531-41b5-bc43-0691f2713fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b376a82c-c857-4bdc-b65c-0aa43bb4f540', 'volume_name': 'volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5d2949-2a45-480d-9427-16f15980dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5d2949-2a45-480d-9427-16f15980dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1b9c6f-1a17-4062-b11b-812876bcc535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:47 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Volume b376a82c-c857-4bdc-b65c-0aa43bb4f540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540', 'volume_size': 1} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63955780-0969-4ef7-a2d6-d8e3d577288e,created_at=2026-06-23T10:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2102661184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63955780-0969-4ef7-a2d6-d8e3d577288e,host='devstack@QuobyteHD#QuobyteHD',id=b376a82c-c857-4bdc-b65c-0aa43bb4f540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3649f6ebeb214aa39428de774dd7b409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:48Z,use_quota=True,user_id='5e9978ce7cea425c9c64e16a846b0cd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7961f2a3-63d7-487f-8840-bfefc6ff651f),volume_type_id=7961f2a3-63d7-487f-8840-bfefc6ff651f)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Creating volume b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:39:47 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:39:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:47 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 1073741824 Jun 23 12:39:47 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Flow 'volume_create_manager' (eca91237-4993-4e8b-8491-f36d00712250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0df68cc-7b5e-40b1-84b3-22b123bd7bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0df68cc-7b5e-40b1-84b3-22b123bd7bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1679233018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d849a92-6cf1-498b-aaf3-3713138302c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9557180e52d44ce898826305f5f10f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:48Z,use_quota=True,user_id='17e2fec5275f4a43acd1e016e6c976c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf5c77-f56d-4d44-a4f3-a970be978f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dcf5c77-f56d-4d44-a4f3-a970be978f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8e37e5-fcdb-4d59-bd5e-b1c9ecaa65f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c8e37e5-fcdb-4d59-bd5e-b1c9ecaa65f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d849a92-6cf1-498b-aaf3-3713138302c2', 'volume_name': 'volume-2d849a92-6cf1-498b-aaf3-3713138302c2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad745b6e-0269-4942-9815-50257ca77c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad745b6e-0269-4942-9815-50257ca77c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0dbb7b-a1f6-492d-a123-d1df5b704dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:48 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Volume 2d849a92-6cf1-498b-aaf3-3713138302c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d849a92-6cf1-498b-aaf3-3713138302c2', 'volume_size': 1} Jun 23 12:39:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:49 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 1073741824" returned: 0 in 1.194s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:49 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 Jun 23 12:39:49 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:50 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540" returned: 0 in 0.990s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.248s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1679233018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d849a92-6cf1-498b-aaf3-3713138302c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9557180e52d44ce898826305f5f10f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:39:48Z,use_quota=True,user_id='17e2fec5275f4a43acd1e016e6c976c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Creating volume 2d849a92-6cf1-498b-aaf3-3713138302c2 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:39:50 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:50 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 1073741824 Jun 23 12:39:50 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d1b9c6f-1a17-4062-b11b-812876bcc535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22a0593-7404-46ef-85d6-f5fe2a048e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:50 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Volume volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 (b376a82c-c857-4bdc-b65c-0aa43bb4f540): created successfully Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22a0593-7404-46ef-85d6-f5fe2a048e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Flow 'volume_create_manager' (6355af9d-c586-46a2-bbf4-941e2e13753d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-95b9800a-7f79-405e-b507-a0c117ab7961 tempest-GroupSnapshotsV319Test-500130977 None] Created volume successfully. Jun 23 12:39:51 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] GroupSnapshot 5fe9f402-c276-40ab-a1a0-83ab8ba32046: creating. Jun 23 12:39:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Group snapshot 5fe9f402-c276-40ab-a1a0-83ab8ba32046: creating. {{(pid=93659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 12:39:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:39:51 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 1073741824" returned: 0 in 1.496s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:51 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 Jun 23 12:39:51 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:52 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2" returned: 0 in 0.785s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] <== create_volume: return (2339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.341s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.029s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0dbb7b-a1f6-492d-a123-d1df5b704dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d849a92-6cf1-498b-aaf3-3713138302c2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b00e82-461c-44c2-aeec-3a1a2f141fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Creating offline snapshot db800495-8ac7-4275-8892-5cb6e1b0724a of volume b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:39:52 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Volume volume-2d849a92-6cf1-498b-aaf3-3713138302c2 (2d849a92-6cf1-498b-aaf3-3713138302c2): created successfully Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b00e82-461c-44c2-aeec-3a1a2f141fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Flow 'volume_create_manager' (eca91237-4993-4e8b-8491-f36d00712250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35a9151-da5d-465b-8f4e-39060791962e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:39:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:52 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4be59851-c68f-4c26-b36b-0e2ee6f45cfb tempest-ServerActionsTestOtherA-473957467 None] Created volume successfully. Jun 23 12:39:52 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 Jun 23 12:39:52 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:53 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540" returned: 0 in 1.345s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:53 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a 1G Jun 23 12:39:53 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:54 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a 1G" returned: 0 in 0.898s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:54 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a Jun 23 12:39:54 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-11e5f2e1-ef82-4ea1-9cbf-c861bb6bf2c1 req-13f5112f-8a65-4dc9-aa35-aa668b341b41 tempest-DeleteServersTestJSON-1057827244 None] Terminate volume connection completed successfully. Jun 23 12:39:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-11e5f2e1-ef82-4ea1-9cbf-c861bb6bf2c1 req-13f5112f-8a65-4dc9-aa35-aa668b341b41 tempest-DeleteServersTestJSON-1057827244 None] Deleting attachment c8871daf-a625-4f11-82e4-fa975ef7a3fc. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:39:55 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a" returned: 0 in 0.763s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:55 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:39:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:55 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a Jun 23 12:39:55 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:56 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a" returned: 0 in 0.693s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:56 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.info Jun 23 12:39:56 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:56 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.info" returned: 0 in 0.660s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:56 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:39:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:56 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.info Jun 23 12:39:56 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:39:57 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jun 23 12:39:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.info" returned: 0 in 0.719s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:39:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.219s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:39:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f7955567-f356-49bd-8164-d214f75a5c7e tempest-GroupSnapshotsV319Test-500130977 None] group_snapshot 5fe9f402-c276-40ab-a1a0-83ab8ba32046: created successfully Jun 23 12:39:59 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] group_snapshot 5fe9f402-c276-40ab-a1a0-83ab8ba32046: deleting Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] group_snapshot 5fe9f402-c276-40ab-a1a0-83ab8ba32046: deleting {{(pid=93659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Acquiring lock "cinder-quobyte-b376a82c-c857-4bdc-b65c-0aa43bb4f540" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Lock "cinder-quobyte-b376a82c-c857-4bdc-b65c-0aa43bb4f540" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Acquiring lock "cinder-quobyte-db800495-8ac7-4275-8892-5cb6e1b0724a" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Lock "cinder-quobyte-db800495-8ac7-4275-8892-5cb6e1b0724a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Deleting offline snapshot db800495-8ac7-4275-8892-5cb6e1b0724a of volume b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] snapshot_file for this snap is: volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c282ed-ead7-47c5-ab71-bb468b744c32]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:39:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:39:59 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a Jun 23 12:39:59 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:00 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a" returned: 0 in 0.941s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:40:00 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[730601ca-1e10-441e-ac9a-6c7ee408ae62]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:00 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 Jun 23 12:40:00 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Acquiring lock "cinder-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:40:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Lock "cinder-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:40:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Acquiring lock "cinder-quobyte-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:40:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Lock "cinder-quobyte-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9" acquired by "delete_volume" :: waited 0.035s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:40:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad17a40-ba08-45c1-ab58-bd6bcc1234e0]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:01 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 Jun 23 12:40:01 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:01 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540" returned: 0 in 0.967s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:01 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a Jun 23 12:40:01 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:01 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9" returned: 0 in 0.916s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:02 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9 Jun 23 12:40:02 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:02 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a" returned: 0 in 0.992s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:02 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a Jun 23 12:40:02 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:02 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9" returned: 0 in 0.815s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Lock "cinder-quobyte-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9" released by "delete_volume" :: held 1.784s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Created reservations ['820f4f40-be25-41e1-9e6c-242a786ca454', '19ce5289-b1be-474f-bb2f-0da016000358', '5fc0923b-d0d0-4a3f-ad6c-06187d245a25', 'd88d89a9-0e39-4e03-8455-837b199513f3'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:02 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:40:02 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:03 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540.db800495-8ac7-4275-8892-5cb6e1b0724a" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Lock "cinder-quobyte-db800495-8ac7-4275-8892-5cb6e1b0724a" released by "_delete_snapshot" :: held 3.899s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Lock "cinder-quobyte-b376a82c-c857-4bdc-b65c-0aa43bb4f540" released by "delete_snapshot" :: held 3.932s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:03 devstack cinder-volume[93659]: WARNING cinder.quota [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1949292734 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1949292734, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:40:03 devstack cinder-volume[93659]: WARNING cinder.quota [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1949292734 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1949292734, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:40:03 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] Created reservations ['adaf10e6-fa60-41ef-af48-fdccc58c6118', '789c4694-85f5-4ff0-95c6-f54071ec5b6a', '7384083f-cb5f-47f8-b349-4242c0cd894c', '63edabfb-504b-4df2-9779-b0121d5128ea'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-72d96db1-88a3-45df-811e-69e07d3705c2 tempest-GroupSnapshotsV319Test-500130977 None] group_snapshot 5fe9f402-c276-40ab-a1a0-83ab8ba32046: deleted successfully Jun 23 12:40:03 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.887s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:03 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:40:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Deleted volume successfully. Jun 23 12:40:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ced41159-2d7a-4395-a61a-342986a90ead tempest-DeleteServersTestJSON-1057827244 None] Lock "cinder-0ef949ae-f8c3-4fcd-aa98-1b8e71907ab9-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Acquiring lock "cinder-quobyte-b376a82c-c857-4bdc-b65c-0aa43bb4f540" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:40:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Lock "cinder-quobyte-b376a82c-c857-4bdc-b65c-0aa43bb4f540" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:40:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e840c1-7fba-4a84-9d42-1c9220f56427]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:04 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 Jun 23 12:40:04 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:05 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540" returned: 0 in 0.918s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:05 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540 Jun 23 12:40:05 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:06 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b376a82c-c857-4bdc-b65c-0aa43bb4f540" returned: 0 in 0.677s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Lock "cinder-quobyte-b376a82c-c857-4bdc-b65c-0aa43bb4f540" released by "delete_volume" :: held 1.673s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Created reservations ['fa3574fd-ac9c-4231-a52c-7e9b9e3ae081'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:06 devstack cinder-volume[93659]: WARNING cinder.quota [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1949292734 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1949292734, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Created reservations ['0fe42b10-190c-4aa8-9540-024e5d1b6ba8', 'bbd43908-e208-415b-b4c0-60b2ae12bf96', '3c9db46a-32ee-45ed-9d74-8285f6bda9a6', 'd58c99d3-6b74-4dd5-8080-9627fdbb868d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:06 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:40:06 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:07 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.917s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:07 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:40:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d12e440f-1cc0-4fcb-8877-37048dda91bd tempest-GroupSnapshotsV319Test-500130977 None] Delete group completed successfully. Jun 23 12:40:16 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=49,cinder:UPDATE=48,cinder:INSERT=12,cinder:DELETE=5 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:40:16 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=45,cinder:UPDATE=51,cinder:DELETE=1,cinder:INSERT=10 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:40:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-af7a628e-b7c6-48e6-8b82-741e8942b3af tempest-GroupsTest-1476921999 None] Group tempest-Group1-792081786: creating Jun 23 12:40:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-af7a628e-b7c6-48e6-8b82-741e8942b3af tempest-GroupsTest-1476921999 None] Group tempest-Group1-792081786: created successfully Jun 23 12:40:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-af7a628e-b7c6-48e6-8b82-741e8942b3af tempest-GroupsTest-1476921999 None] Create group completed successfully. Jun 23 12:40:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c859f4b7-4f3a-4a52-b960-3a259c6f72ee tempest-GroupsTest-1476921999 None] Group tempest-Group2-29797625: creating Jun 23 12:40:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c859f4b7-4f3a-4a52-b960-3a259c6f72ee tempest-GroupsTest-1476921999 None] Group tempest-Group2-29797625: created successfully Jun 23 12:40:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c859f4b7-4f3a-4a52-b960-3a259c6f72ee tempest-GroupsTest-1476921999 None] Create group completed successfully. Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Flow 'volume_create_manager' (52b431cf-45ad-4809-86ee-96001c6feb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaecebab-0ed3-44a8-92af-a29675d3cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaecebab-0ed3-44a8-92af-a29675d3cee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1331285016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a427c89f-02f2-46c5-b51f-9f088be60e34,host='devstack@QuobyteHD#QuobyteHD',id=cee39a66-209d-40ec-9b1f-c0ebd6bed9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac876b53aa3474487f0ffd7af81b19f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:22Z,use_quota=True,user_id='d174a907d526473995b1f699822ef885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f126e991-791c-4e20-86f8-62d06d898866),volume_type_id=f126e991-791c-4e20-86f8-62d06d898866)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d730ee-83ee-40fe-ad6d-6593363fe8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02d730ee-83ee-40fe-ad6d-6593363fe8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ad80f6-5948-4f76-8610-83ee79b3ecf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0ad80f6-5948-4f76-8610-83ee79b3ecf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee39a66-209d-40ec-9b1f-c0ebd6bed9b4', 'volume_name': 'volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da4df9b-70d1-4472-a57c-3ce3b07f7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da4df9b-70d1-4472-a57c-3ce3b07f7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1eb7982-3e44-41bf-9859-02cee44c9c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:21 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Volume cee39a66-209d-40ec-9b1f-c0ebd6bed9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4', 'volume_size': 1} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a427c89f-02f2-46c5-b51f-9f088be60e34,created_at=2026-06-23T10:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1331285016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a427c89f-02f2-46c5-b51f-9f088be60e34,host='devstack@QuobyteHD#QuobyteHD',id=cee39a66-209d-40ec-9b1f-c0ebd6bed9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac876b53aa3474487f0ffd7af81b19f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:22Z,use_quota=True,user_id='d174a907d526473995b1f699822ef885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f126e991-791c-4e20-86f8-62d06d898866),volume_type_id=f126e991-791c-4e20-86f8-62d06d898866)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Creating volume cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:40:21 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:40:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:21 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 1073741824 Jun 23 12:40:21 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:40:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:22 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:40:22 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:23 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 1073741824" returned: 0 in 1.596s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:23 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.275s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:40:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:40:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 8 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:40:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:40:23 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 Jun 23 12:40:23 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:24 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4" returned: 0 in 1.128s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] <== create_volume: return (2794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:40:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.796s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1eb7982-3e44-41bf-9859-02cee44c9c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188460f5-e419-4461-a91d-7f29f7bdc62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Volume volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 (cee39a66-209d-40ec-9b1f-c0ebd6bed9b4): created successfully Jun 23 12:40:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188460f5-e419-4461-a91d-7f29f7bdc62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Flow 'volume_create_manager' (52b431cf-45ad-4809-86ee-96001c6feb89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:40:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f26bce4c-2810-47bb-86f8-55c30c25eac5 tempest-GroupsTest-1476921999 None] Created volume successfully. Jun 23 12:40:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Acquiring lock "cinder-quobyte-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:40:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Lock "cinder-quobyte-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:40:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47bc925-6f32-4d94-abc1-d49030cfe805]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:26 devstack sudo[95545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 Jun 23 12:40:26 devstack sudo[95545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:27 devstack sudo[95545]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4" returned: 0 in 1.004s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:27 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4 Jun 23 12:40:27 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:28 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4" returned: 0 in 1.076s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Lock "cinder-quobyte-cee39a66-209d-40ec-9b1f-c0ebd6bed9b4" released by "delete_volume" :: held 2.145s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:28 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Created reservations ['7cb12cd5-3962-4d8a-a737-6aa8c9c701f9'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:28 devstack cinder-volume[93659]: WARNING cinder.quota [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-720577516 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-720577516, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:40:28 devstack cinder-volume[93659]: WARNING cinder.quota [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-720577516 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-720577516, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:40:28 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Created reservations ['141d52cb-9014-4018-845a-4624f07930c8', 'ea109a68-0230-4190-9cc7-fd77cf5151c6', 'c8d2b260-70f2-496c-9eae-210631f060bb', '60fd14f2-1f75-41e5-937b-0b3145cbdcb2'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:29 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:40:29 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:30 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.914s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:40:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-10cea0e3-f7e1-47fb-87d2-7368000ff3f5 tempest-GroupsTest-1476921999 None] Delete group completed successfully. Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Created reservations ['a749f574-8beb-48b0-be24-5776a7b382cf'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:30 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:40:30 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:31 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.702s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:31 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:40:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f9a1171c-839f-4e27-b292-f9edbd8e5777 tempest-GroupsTest-1476921999 None] Delete group completed successfully. Jun 23 12:40:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d606cd03-817b-4c6e-b64d-1447a3d3749e tempest-GroupsTest-1476921999 None] Group tempest-GroupsTest-Group-1995593334: creating Jun 23 12:40:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d606cd03-817b-4c6e-b64d-1447a3d3749e tempest-GroupsTest-1476921999 None] Group tempest-GroupsTest-Group-1995593334: created successfully Jun 23 12:40:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d606cd03-817b-4c6e-b64d-1447a3d3749e tempest-GroupsTest-1476921999 None] Create group completed successfully. Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Flow 'volume_create_manager' (582898c1-2455-4228-89b2-4ca1735521a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaf670f-adf0-41ab-a563-6f2231616894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcaf670f-adf0-41ab-a563-6f2231616894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1910549421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d576d-d27a-453d-aa12-f564f986329d,host='devstack@QuobyteHD#QuobyteHD',id=1738152d-ab5d-4f59-a453-df4719c7de89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac876b53aa3474487f0ffd7af81b19f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:34Z,use_quota=True,user_id='d174a907d526473995b1f699822ef885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4457d964-dc05-4f1c-8fe3-42479a1d2204),volume_type_id=4457d964-dc05-4f1c-8fe3-42479a1d2204)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19aac57c-8981-430e-824d-2cbfb9e608ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19aac57c-8981-430e-824d-2cbfb9e608ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f14106-c9e4-4f6c-bbe6-ae55ee0ae3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f14106-c9e4-4f6c-bbe6-ae55ee0ae3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1738152d-ab5d-4f59-a453-df4719c7de89', 'volume_name': 'volume-1738152d-ab5d-4f59-a453-df4719c7de89', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc0b02f-a502-480d-be6f-87ea4082f603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc0b02f-a502-480d-be6f-87ea4082f603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949ea9ae-ea37-449f-8c83-1cc53f7dc135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:34 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Volume 1738152d-ab5d-4f59-a453-df4719c7de89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1738152d-ab5d-4f59-a453-df4719c7de89', 'volume_size': 1} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=091d576d-d27a-453d-aa12-f564f986329d,created_at=2026-06-23T10:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1910549421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d576d-d27a-453d-aa12-f564f986329d,host='devstack@QuobyteHD#QuobyteHD',id=1738152d-ab5d-4f59-a453-df4719c7de89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac876b53aa3474487f0ffd7af81b19f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:34Z,use_quota=True,user_id='d174a907d526473995b1f699822ef885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4457d964-dc05-4f1c-8fe3-42479a1d2204),volume_type_id=4457d964-dc05-4f1c-8fe3-42479a1d2204)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Creating volume 1738152d-ab5d-4f59-a453-df4719c7de89 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:40:34 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:40:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:34 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 1073741824 Jun 23 12:40:34 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:35 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 1073741824" returned: 0 in 1.033s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:35 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 Jun 23 12:40:35 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:36 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89" returned: 0 in 0.663s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:40:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949ea9ae-ea37-449f-8c83-1cc53f7dc135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1738152d-ab5d-4f59-a453-df4719c7de89', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6dbc28-e21e-41b2-9863-58f8be978aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:36 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Volume volume-1738152d-ab5d-4f59-a453-df4719c7de89 (1738152d-ab5d-4f59-a453-df4719c7de89): created successfully Jun 23 12:40:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e6dbc28-e21e-41b2-9863-58f8be978aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Flow 'volume_create_manager' (582898c1-2455-4228-89b2-4ca1735521a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:40:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ea54027d-0fac-4a05-996a-c41db77e9e97 tempest-GroupsTest-1476921999 None] Created volume successfully. Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Flow 'volume_create_manager' (f2fb4cdb-9051-4c32-a68a-a35d8760409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b141610a-bc66-4dfb-bdc6-42086b2ac62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b141610a-bc66-4dfb-bdc6-42086b2ac62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283178276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d576d-d27a-453d-aa12-f564f986329d,host='devstack@QuobyteHD#QuobyteHD',id=ab621da8-7f84-4a18-b3d3-e42a74abc173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac876b53aa3474487f0ffd7af81b19f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:37Z,use_quota=True,user_id='d174a907d526473995b1f699822ef885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4457d964-dc05-4f1c-8fe3-42479a1d2204),volume_type_id=4457d964-dc05-4f1c-8fe3-42479a1d2204)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cddec46-41b2-4abc-9f63-d20733adb581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cddec46-41b2-4abc-9f63-d20733adb581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513d9dd-738a-49bf-a738-fe5d4554b5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7513d9dd-738a-49bf-a738-fe5d4554b5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab621da8-7f84-4a18-b3d3-e42a74abc173', 'volume_name': 'volume-ab621da8-7f84-4a18-b3d3-e42a74abc173', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee56a682-224b-43eb-9783-e6780656e16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee56a682-224b-43eb-9783-e6780656e16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4f180-212e-47bb-b617-4af0761e2745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:37 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Volume ab621da8-7f84-4a18-b3d3-e42a74abc173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab621da8-7f84-4a18-b3d3-e42a74abc173', 'volume_size': 1} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=091d576d-d27a-453d-aa12-f564f986329d,created_at=2026-06-23T10:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283178276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=091d576d-d27a-453d-aa12-f564f986329d,host='devstack@QuobyteHD#QuobyteHD',id=ab621da8-7f84-4a18-b3d3-e42a74abc173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ac876b53aa3474487f0ffd7af81b19f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:37Z,use_quota=True,user_id='d174a907d526473995b1f699822ef885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4457d964-dc05-4f1c-8fe3-42479a1d2204),volume_type_id=4457d964-dc05-4f1c-8fe3-42479a1d2204)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Creating volume ab621da8-7f84-4a18-b3d3-e42a74abc173 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:40:37 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:40:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:37 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 1073741824 Jun 23 12:40:37 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:38 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 1073741824" returned: 0 in 1.029s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:38 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 Jun 23 12:40:38 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-ba518e6b-de0b-4772-a59d-563d60486574 req-250437ee-45d9-430c-a8a2-873e3d516194 tempest-ServerActionsTestOtherA-473957467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:39 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173" returned: 0 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-ba518e6b-de0b-4772-a59d-563d60486574 req-250437ee-45d9-430c-a8a2-873e3d516194 tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.537s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf4f180-212e-47bb-b617-4af0761e2745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab621da8-7f84-4a18-b3d3-e42a74abc173', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a16a37-4fce-4dc0-87d1-4a3d6d588635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[402c8fe7-4dbd-4e1c-a1ad-5ef96b6454fd]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-ba518e6b-de0b-4772-a59d-563d60486574 req-250437ee-45d9-430c-a8a2-873e3d516194 tempest-ServerActionsTestOtherA-473957467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:39 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Volume volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 (ab621da8-7f84-4a18-b3d3-e42a74abc173): created successfully Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a16a37-4fce-4dc0-87d1-4a3d6d588635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Flow 'volume_create_manager' (f2fb4cdb-9051-4c32-a68a-a35d8760409a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:40:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e66dd96b-a733-4342-b9ea-013d753b2722 tempest-GroupsTest-1476921999 None] Created volume successfully. Jun 23 12:40:39 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 Jun 23 12:40:39 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a20c301c-7502-46e6-9eb5-399a0e00ec94 tempest-GroupsTest-1476921999 None] Update group completed successfully. Jun 23 12:40:40 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-ba518e6b-de0b-4772-a59d-563d60486574 req-250437ee-45d9-430c-a8a2-873e3d516194 tempest-ServerActionsTestOtherA-473957467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2" returned: 0 in 0.989s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-ba518e6b-de0b-4772-a59d-563d60486574 req-250437ee-45d9-430c-a8a2-873e3d516194 tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.019s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-ba518e6b-de0b-4772-a59d-563d60486574 req-250437ee-45d9-430c-a8a2-873e3d516194 tempest-ServerActionsTestOtherA-473957467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-2d849a92-6cf1-498b-aaf3-3713138302c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9db4a1ad-8751-434b-b86e-77abab05c516', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:40:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-ba518e6b-de0b-4772-a59d-563d60486574 req-250437ee-45d9-430c-a8a2-873e3d516194 tempest-ServerActionsTestOtherA-473957467 None] attachment_update completed successfully. Jun 23 12:40:41 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9fca2f83-6c7c-4967-b992-d6d458baf63b tempest-GroupsTest-1476921999 None] Update group completed successfully. Jun 23 12:40:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Acquiring lock "cinder-quobyte-1738152d-ab5d-4f59-a453-df4719c7de89" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:40:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Lock "cinder-quobyte-1738152d-ab5d-4f59-a453-df4719c7de89" acquired by "delete_volume" :: waited 0.034s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:40:43 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[81197831-25fd-4f95-8899-c8aa52a86464]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:43 devstack sudo[96072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 Jun 23 12:40:43 devstack sudo[96072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:44 devstack sudo[96072]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89" returned: 0 in 0.928s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:44 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89 Jun 23 12:40:44 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:45 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1738152d-ab5d-4f59-a453-df4719c7de89" returned: 0 in 1.109s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Lock "cinder-quobyte-1738152d-ab5d-4f59-a453-df4719c7de89" released by "delete_volume" :: held 2.106s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Acquiring lock "cinder-quobyte-ab621da8-7f84-4a18-b3d3-e42a74abc173" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:40:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Lock "cinder-quobyte-ab621da8-7f84-4a18-b3d3-e42a74abc173" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:40:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[362ac395-3bc3-49c2-8c66-c61d8d1c93a7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:45 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 Jun 23 12:40:45 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:46 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173" returned: 0 in 1.028s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:46 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173 Jun 23 12:40:46 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:48 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab621da8-7f84-4a18-b3d3-e42a74abc173" returned: 0 in 1.759s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Lock "cinder-quobyte-ab621da8-7f84-4a18-b3d3-e42a74abc173" released by "delete_volume" :: held 2.874s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:40:48 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Created reservations ['9a17109a-d36e-4f63-90aa-95d5078eb7e3'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:48 devstack cinder-volume[93659]: WARNING cinder.quota [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-765215865 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-765215865, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:40:48 devstack cinder-volume[93659]: WARNING cinder.quota [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-765215865 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-765215865, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:40:48 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Created reservations ['b9b917f5-683f-467b-9f90-460edeff7357', 'f27a8224-4909-4ef7-8c32-42af79933ff0', '315c0139-75f9-42ff-bf3d-27cf9a50fed8', '57c58e5e-4851-4e5f-863b-9c043c584ab1'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:49 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Created reservations ['9b350a18-7801-44f2-8f8c-26902c50533c', '86320377-678a-430e-8544-fdabce871528', '6d3ccbf2-886f-4f46-b1c9-900e98baa2a1', '16e5a20c-7fa7-4ee5-89b3-c28e713772e1'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:40:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:49 devstack sudo[96300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:40:49 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-c1a36426-95f7-455c-8a94-8f436fa1bd4f tempest-ServerActionsTestOtherA-473957467 None] Terminate volume connection completed successfully. Jun 23 12:40:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-c1a36426-95f7-455c-8a94-8f436fa1bd4f tempest-ServerActionsTestOtherA-473957467 None] Deleting attachment 9db4a1ad-8751-434b-b86e-77abab05c516. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:40:51 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.640s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:51 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:40:51 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8121d553-e6c7-4a35-8912-6c95ff7fe1fd tempest-GroupsTest-1476921999 None] Delete group completed successfully. Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-27477229-c6cb-41e3-8bf9-70f817efd6c5 tempest-ServerActionsTestOtherA-473957467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-27477229-c6cb-41e3-8bf9-70f817efd6c5 tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce9e14a-82d9-4dee-9cf2-d4780789e1a9]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-27477229-c6cb-41e3-8bf9-70f817efd6c5 tempest-ServerActionsTestOtherA-473957467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Flow 'volume_create_manager' (b33df06c-7751-4b4f-9c6a-57a3b69ff146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989ea10a-52ea-4e7d-adfe-90bf5655eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:53 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 Jun 23 12:40:53 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989ea10a-52ea-4e7d-adfe-90bf5655eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1034580793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b55104-a06f-43cd-baff-7a585aa9930c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e6ed5a2df543a3b99a449eccd0eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:54Z,use_quota=True,user_id='333c9b94fe814f43ac7997672df5c62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27384c8-54cb-445f-962e-dc8ba8f91388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27384c8-54cb-445f-962e-dc8ba8f91388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecc4abe-a41e-484a-b1bd-9258fe87c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ecc4abe-a41e-484a-b1bd-9258fe87c421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b55104-a06f-43cd-baff-7a585aa9930c', 'volume_name': 'volume-27b55104-a06f-43cd-baff-7a585aa9930c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ac32f9-194d-4f34-9a0b-5276d0932a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ac32f9-194d-4f34-9a0b-5276d0932a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:40:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc817c2-db3e-4b04-9ddb-48dc8c7349bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:40:54 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Volume 27b55104-a06f-43cd-baff-7a585aa9930c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b55104-a06f-43cd-baff-7a585aa9930c', 'volume_size': 1} Jun 23 12:40:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:55 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-27477229-c6cb-41e3-8bf9-70f817efd6c5 tempest-ServerActionsTestOtherA-473957467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2" returned: 0 in 1.742s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-27477229-c6cb-41e3-8bf9-70f817efd6c5 tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.804s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.282s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:40:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1034580793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b55104-a06f-43cd-baff-7a585aa9930c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e6ed5a2df543a3b99a449eccd0eef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:40:54Z,use_quota=True,user_id='333c9b94fe814f43ac7997672df5c62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Creating volume 27b55104-a06f-43cd-baff-7a585aa9930c {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:40:55 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:55 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c 1073741824 Jun 23 12:40:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-27477229-c6cb-41e3-8bf9-70f817efd6c5 tempest-ServerActionsTestOtherA-473957467 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-2d849a92-6cf1-498b-aaf3-3713138302c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fd69215-7ca8-4020-b9ec-6a0c0d6414ec', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:40:55 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:55 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-ef401e06-5dd5-47bc-9824-0f28b50e6191 req-27477229-c6cb-41e3-8bf9-70f817efd6c5 tempest-ServerActionsTestOtherA-473957467 None] attachment_update completed successfully. Jun 23 12:40:57 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c 1073741824" returned: 0 in 2.149s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:40:57 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c Jun 23 12:40:57 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:40:59 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Jun 23 12:40:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c" returned: 0 in 2.321s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:40:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] <== create_volume: return (4554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:40:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.562s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecc817c2-db3e-4b04-9ddb-48dc8c7349bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b55104-a06f-43cd-baff-7a585aa9930c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0479230e-7270-4f2c-918e-18f7c4d902f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Volume volume-27b55104-a06f-43cd-baff-7a585aa9930c (27b55104-a06f-43cd-baff-7a585aa9930c): created successfully Jun 23 12:41:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0479230e-7270-4f2c-918e-18f7c4d902f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Flow 'volume_create_manager' (b33df06c-7751-4b4f-9c6a-57a3b69ff146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:00 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e40396d6-8971-4913-881b-15ca110c2bd3 tempest-VolumesAdminNegativeTest-422690633 None] Created volume successfully. Jun 23 12:41:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Acquiring lock "cinder-27b55104-a06f-43cd-baff-7a585aa9930c-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Lock "cinder-27b55104-a06f-43cd-baff-7a585aa9930c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Acquiring lock "cinder-quobyte-27b55104-a06f-43cd-baff-7a585aa9930c" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Lock "cinder-quobyte-27b55104-a06f-43cd-baff-7a585aa9930c" acquired by "delete_volume" :: waited 0.040s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014966f-a43f-4e7c-bb46-a52df51922c1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:41:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:02 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c Jun 23 12:41:02 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:03 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c" returned: 0 in 1.202s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:03 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c Jun 23 12:41:03 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:03 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-27b55104-a06f-43cd-baff-7a585aa9930c" returned: 0 in 0.862s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Lock "cinder-quobyte-27b55104-a06f-43cd-baff-7a585aa9930c" released by "delete_volume" :: held 2.146s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:03 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Created reservations ['86a85fc4-25e5-4ff0-ad41-835e6390e62c', '908010e4-b6e8-4550-b557-b298c61bf30e', '27bd1eaf-a177-44b8-8d80-1c4e3da92d86', '46a079a4-fe63-4c3f-93dd-bac879b2d223'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:41:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:04 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:41:04 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:05 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.082s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:05 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:41:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Deleted volume successfully. Jun 23 12:41:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dd600dda-67d0-44bd-be0f-ddcab794e093 tempest-VolumesAdminNegativeTest-422690633 None] Lock "cinder-27b55104-a06f-43cd-baff-7a585aa9930c-delete_volume" released by "delete_volume" :: held 3.575s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:14 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=60,cinder:SELECT=57,cinder:INSERT=12,cinder:DELETE=2 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:41:15 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=64,cinder:UPDATE=60,cinder:INSERT=11,cinder:DELETE=3 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:41:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:41:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:22 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:41:22 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:23 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.809s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Flow 'volume_create_manager' (71031658-0bd2-4c95-ac00-b57f724af4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c6b325-010b-48d8-aef6-7bde3342d413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c6b325-010b-48d8-aef6-7bde3342d413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1811728834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dea73f6-f988-4a54-9efe-baf64cf2dcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0819e786ca5c496ebc63f759838f4540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:23Z,use_quota=True,user_id='b6416ffa93724faeb9773f2ed9b9578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c8641b-c142-443c-8fa0-4e2ba5be31db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c8641b-c142-443c-8fa0-4e2ba5be31db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d068ddf-42b8-4b57-961c-ec809231fefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d068ddf-42b8-4b57-961c-ec809231fefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dea73f6-f988-4a54-9efe-baf64cf2dcf1', 'volume_name': 'volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59195ab0-0521-4774-8a56-9002d6b8cfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59195ab0-0521-4774-8a56-9002d6b8cfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f935eb-3315-466e-b327-374dbca9a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:23 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Volume 7dea73f6-f988-4a54-9efe-baf64cf2dcf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1', 'volume_size': 1} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1811728834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dea73f6-f988-4a54-9efe-baf64cf2dcf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0819e786ca5c496ebc63f759838f4540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:23Z,use_quota=True,user_id='b6416ffa93724faeb9773f2ed9b9578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Creating volume 7dea73f6-f988-4a54-9efe-baf64cf2dcf1 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:41:23 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:41:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:23 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 1073741824 Jun 23 12:41:23 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:24 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 1073741824" returned: 0 in 1.045s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:24 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 Jun 23 12:41:24 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:25 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1" returned: 0 in 0.713s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:41:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82f935eb-3315-466e-b327-374dbca9a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67de614f-883d-4ffc-ac56-2cecc550960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:25 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Volume volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 (7dea73f6-f988-4a54-9efe-baf64cf2dcf1): created successfully Jun 23 12:41:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67de614f-883d-4ffc-ac56-2cecc550960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Flow 'volume_create_manager' (71031658-0bd2-4c95-ac00-b57f724af4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:25 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-afaafbaa-7d13-4055-9d5d-556f415a83e7 tempest-ServersNegativeTestJSON-910768187 None] Created volume successfully. Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Flow 'volume_create_manager' (8efb3ae3-74f5-4d7e-a4f6-983e08423daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573c4435-dba5-4a62-b8c7-4e051b9d805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (573c4435-dba5-4a62-b8c7-4e051b9d805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1823013007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca1d68f-b539-498e-b62e-81d395406ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0819e786ca5c496ebc63f759838f4540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:27Z,use_quota=True,user_id='b6416ffa93724faeb9773f2ed9b9578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5c6ada-4907-43ea-92aa-daeeb6995299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a5c6ada-4907-43ea-92aa-daeeb6995299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4c01fb-e452-45a1-ba10-3755a3bce75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4c01fb-e452-45a1-ba10-3755a3bce75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ca1d68f-b539-498e-b62e-81d395406ea9', 'volume_name': 'volume-0ca1d68f-b539-498e-b62e-81d395406ea9', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9f2132-cf40-4f26-9160-2dbb626136ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9f2132-cf40-4f26-9160-2dbb626136ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3885dc9b-8564-475b-84e7-c05637d374da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Volume 0ca1d68f-b539-498e-b62e-81d395406ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ca1d68f-b539-498e-b62e-81d395406ea9', 'volume_size': 1} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1823013007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ca1d68f-b539-498e-b62e-81d395406ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0819e786ca5c496ebc63f759838f4540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:27Z,use_quota=True,user_id='b6416ffa93724faeb9773f2ed9b9578e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Creating volume 0ca1d68f-b539-498e-b62e-81d395406ea9 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:41:27 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:27 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 1073741824 Jun 23 12:41:27 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Flow 'volume_create_manager' (0edff6ba-b0dc-4c04-880e-eec1eb98d5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d857f941-326c-4b91-872d-80fe9790b2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d857f941-326c-4b91-872d-80fe9790b2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1202021286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e70eec9-14de-45b2-a21f-5e18ae682210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f6dad6ad624a998c0e45e8f18f7c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:28Z,use_quota=True,user_id='3e95d54de7a54b849f569b06915a03f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca1fe0a-f749-47fc-894c-c2d6440b6c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca1fe0a-f749-47fc-894c-c2d6440b6c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c023a8-68ee-44b8-8cc5-031be6b59b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c023a8-68ee-44b8-8cc5-031be6b59b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e70eec9-14de-45b2-a21f-5e18ae682210', 'volume_name': 'volume-8e70eec9-14de-45b2-a21f-5e18ae682210', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8050836e-921b-44eb-849e-ec05a8d331fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8050836e-921b-44eb-849e-ec05a8d331fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568f97b1-412d-44bf-9b61-42b229a6cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Volume 8e70eec9-14de-45b2-a21f-5e18ae682210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e70eec9-14de-45b2-a21f-5e18ae682210', 'volume_size': 1} Jun 23 12:41:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:28 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 1073741824" returned: 0 in 1.014s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:28 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 Jun 23 12:41:28 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:29 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9" returned: 0 in 0.924s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1202021286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e70eec9-14de-45b2-a21f-5e18ae682210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f6dad6ad624a998c0e45e8f18f7c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:28Z,use_quota=True,user_id='3e95d54de7a54b849f569b06915a03f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Creating volume 8e70eec9-14de-45b2-a21f-5e18ae682210 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:41:29 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:29 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 1073741824 Jun 23 12:41:29 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3885dc9b-8564-475b-84e7-c05637d374da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ca1d68f-b539-498e-b62e-81d395406ea9', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95657bb-2e4b-43af-bb27-3e9d72b78085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:29 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Volume volume-0ca1d68f-b539-498e-b62e-81d395406ea9 (0ca1d68f-b539-498e-b62e-81d395406ea9): created successfully Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95657bb-2e4b-43af-bb27-3e9d72b78085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Flow 'volume_create_manager' (8efb3ae3-74f5-4d7e-a4f6-983e08423daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-67c93aa9-70fa-4a98-8fab-98b09c97691a tempest-ServersNegativeTestJSON-910768187 None] Created volume successfully. Jun 23 12:41:30 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 1073741824" returned: 0 in 0.909s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:30 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 Jun 23 12:41:30 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "cinder-0ca1d68f-b539-498e-b62e-81d395406ea9-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-0ca1d68f-b539-498e-b62e-81d395406ea9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "cinder-quobyte-0ca1d68f-b539-498e-b62e-81d395406ea9" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:31 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210" returned: 0 in 0.932s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-quobyte-0ca1d68f-b539-498e-b62e-81d395406ea9" acquired by "delete_volume" :: waited 0.040s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568f97b1-412d-44bf-9b61-42b229a6cecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e70eec9-14de-45b2-a21f-5e18ae682210', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3854688-c326-468b-b884-0e81b334f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0050833-c4ee-4d3c-b672-bb8ec6c85423]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:31 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Volume volume-8e70eec9-14de-45b2-a21f-5e18ae682210 (8e70eec9-14de-45b2-a21f-5e18ae682210): created successfully Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3854688-c326-468b-b884-0e81b334f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Flow 'volume_create_manager' (0edff6ba-b0dc-4c04-880e-eec1eb98d5dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c0bb7cb5-357c-4733-918f-8918c9853dad tempest-VolumeQuotasAdminTestJSON-1039605701 None] Created volume successfully. Jun 23 12:41:31 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 Jun 23 12:41:31 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Acquiring lock "cinder-8e70eec9-14de-45b2-a21f-5e18ae682210-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:32 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "cinder-8e70eec9-14de-45b2-a21f-5e18ae682210-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9" returned: 0 in 0.997s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:32 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9 Jun 23 12:41:32 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Acquiring lock "cinder-quobyte-8e70eec9-14de-45b2-a21f-5e18ae682210" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "cinder-quobyte-8e70eec9-14de-45b2-a21f-5e18ae682210" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afcc2d7-c458-444a-bd83-cd9b65d85ca0]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:41:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:32 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 Jun 23 12:41:32 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:33 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0ca1d68f-b539-498e-b62e-81d395406ea9" returned: 0 in 1.087s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-quobyte-0ca1d68f-b539-498e-b62e-81d395406ea9" released by "delete_volume" :: held 2.172s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Created reservations ['c5456997-794c-4a04-9b17-6b039c566635', '85fd0163-c6a1-4ede-bc43-210d81e0bf62', '10ca60bf-3520-457d-9320-cc6101910a8d', 'dd9e9206-d2bf-40f7-929e-73632296e2af'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:41:33 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-f3b10db6-0b46-4fea-a7d4-c05820aa0960 req-1b296fb5-951e-495e-8a23-435155f7497f tempest-ServerActionsTestOtherA-473957467 None] Terminate volume connection completed successfully. Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f3b10db6-0b46-4fea-a7d4-c05820aa0960 req-1b296fb5-951e-495e-8a23-435155f7497f tempest-ServerActionsTestOtherA-473957467 None] Deleting attachment 1fd69215-7ca8-4020-b9ec-6a0c0d6414ec. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:33 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210" returned: 0 in 1.299s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:33 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:41:33 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:33 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210 Jun 23 12:41:33 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "cinder-7dea73f6-f988-4a54-9efe-baf64cf2dcf1-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-7dea73f6-f988-4a54-9efe-baf64cf2dcf1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:34 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:34 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e70eec9-14de-45b2-a21f-5e18ae682210" returned: 0 in 0.751s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.781s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "cinder-quobyte-8e70eec9-14de-45b2-a21f-5e18ae682210" released by "delete_volume" :: held 2.113s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Deleted volume successfully. Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "cinder-quobyte-7dea73f6-f988-4a54-9efe-baf64cf2dcf1" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-quobyte-7dea73f6-f988-4a54-9efe-baf64cf2dcf1" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e10167c3-7309-4f2e-85c9-845d1dd253b9 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-0ca1d68f-b539-498e-b62e-81d395406ea9-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cb8de-ee1d-4563-92b5-0bc38853a324]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Created reservations ['1149fadf-5020-4aae-8c16-945d22daed22', 'bc487e29-7011-440e-b056-faa992e6ecd3', '7da5b58f-af18-42bd-b51b-f0f4dca2ba26', '8ead1f76-ce53-4c44-9966-e61acc117b7d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:34 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 Jun 23 12:41:34 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:34 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:41:34 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:35 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.832s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:35 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:41:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Deleted volume successfully. Jun 23 12:41:35 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9174e4eb-a127-4de1-8f5f-92648106bde5 tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "cinder-8e70eec9-14de-45b2-a21f-5e18ae682210-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1" returned: 0 in 1.027s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:35 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1 Jun 23 12:41:35 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Flow 'volume_create_manager' (942714a7-3fd9-40dd-a5ba-86f77fbb08a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f4c95a-ba3f-498a-8043-5d0dfd7bb19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f4c95a-ba3f-498a-8043-5d0dfd7bb19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1963667199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7e3176-32b4-4a1e-a20e-28c3e356bff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f6dad6ad624a998c0e45e8f18f7c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:36Z,use_quota=True,user_id='3e95d54de7a54b849f569b06915a03f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7095fa29-d43c-4948-adbf-62775888c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7095fa29-d43c-4948-adbf-62775888c068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dac0816-5dd3-4e68-bdb7-5af89e43c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dac0816-5dd3-4e68-bdb7-5af89e43c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c7e3176-32b4-4a1e-a20e-28c3e356bff8', 'volume_name': 'volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a020a2cb-d864-4b23-acc7-7b6fea75f9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a020a2cb-d864-4b23-acc7-7b6fea75f9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae23762-0edb-4b82-8924-94ebde7bf0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:36 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Volume 4c7e3176-32b4-4a1e-a20e-28c3e356bff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8', 'volume_size': 1} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1963667199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c7e3176-32b4-4a1e-a20e-28c3e356bff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f6dad6ad624a998c0e45e8f18f7c97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:36Z,use_quota=True,user_id='3e95d54de7a54b849f569b06915a03f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Creating volume 4c7e3176-32b4-4a1e-a20e-28c3e356bff8 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:41:36 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:36 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 1073741824 Jun 23 12:41:36 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:36 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7dea73f6-f988-4a54-9efe-baf64cf2dcf1" returned: 0 in 0.982s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-quobyte-7dea73f6-f988-4a54-9efe-baf64cf2dcf1" released by "delete_volume" :: held 2.062s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Created reservations ['80e0e63b-16ca-4102-805a-5ecde66076eb', '3f3108aa-3be8-4f8a-9143-65ae5ec935a6', '176e06f8-a354-44af-ac15-eee894f47061', '870f8058-c20f-446b-9362-806897a10589'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:36 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:41:36 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:37 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.881s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:37 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:41:37 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Deleted volume successfully. Jun 23 12:41:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a1e8a70-6957-42da-9980-71bb0ecabb83 tempest-ServersNegativeTestJSON-910768187 None] Lock "cinder-7dea73f6-f988-4a54-9efe-baf64cf2dcf1-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:37 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 1073741824" returned: 0 in 1.416s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:37 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 Jun 23 12:41:37 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:38 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8" returned: 0 in 0.781s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] <== create_volume: return (2265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:41:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.269s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae23762-0edb-4b82-8924-94ebde7bf0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4765ed0d-eb1e-4a09-992a-765665b366e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:38 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Volume volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 (4c7e3176-32b4-4a1e-a20e-28c3e356bff8): created successfully Jun 23 12:41:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4765ed0d-eb1e-4a09-992a-765665b366e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Flow 'volume_create_manager' (942714a7-3fd9-40dd-a5ba-86f77fbb08a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7526fded-d72d-4b67-a1ba-c5e2ad342b2a tempest-VolumeQuotasAdminTestJSON-1039605701 None] Created volume successfully. Jun 23 12:41:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e9865f01-8304-4cbc-a600-fa0074eea051 tempest-VolumeQuotasAdminTestJSON-399636169 None] Transfer volume completed successfully. Jun 23 12:41:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Acquiring lock "cinder-4c7e3176-32b4-4a1e-a20e-28c3e356bff8-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Lock "cinder-4c7e3176-32b4-4a1e-a20e-28c3e356bff8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Acquiring lock "cinder-quobyte-4c7e3176-32b4-4a1e-a20e-28c3e356bff8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Lock "cinder-quobyte-4c7e3176-32b4-4a1e-a20e-28c3e356bff8" acquired by "delete_volume" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:41 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7966c4c9-f4cb-453f-b56a-56cf11b319da]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:41:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:41 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 Jun 23 12:41:41 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:42 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8" returned: 0 in 0.891s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:42 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8 Jun 23 12:41:42 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:43 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4c7e3176-32b4-4a1e-a20e-28c3e356bff8" returned: 0 in 0.726s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Lock "cinder-quobyte-4c7e3176-32b4-4a1e-a20e-28c3e356bff8" released by "delete_volume" :: held 1.675s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Created reservations ['99ef853f-42f7-4178-8bf7-143df589005b', '420905cf-d5fb-4964-8d63-a362eb6bf86e', 'cc79edc9-b81a-429e-8567-b40786d4bbad', 'fa5a010c-0e90-4736-b37c-a8bca251ab01'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:43 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:41:43 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:44 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.911s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:44 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:41:44 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Deleted volume successfully. Jun 23 12:41:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c6381e0f-8e72-4955-bb70-0f41d4987162 tempest-VolumeQuotasAdminTestJSON-2010967676 None] Lock "cinder-4c7e3176-32b4-4a1e-a20e-28c3e356bff8-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Acquiring lock "cinder-2d849a92-6cf1-498b-aaf3-3713138302c2-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Lock "cinder-2d849a92-6cf1-498b-aaf3-3713138302c2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Acquiring lock "cinder-quobyte-2d849a92-6cf1-498b-aaf3-3713138302c2" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:41:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Lock "cinder-quobyte-2d849a92-6cf1-498b-aaf3-3713138302c2" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:41:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcb0bfd-734c-4f0b-86c1-7fbf939cb2a7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:41:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:45 devstack sudo[97386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 Jun 23 12:41:45 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:46 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2" returned: 0 in 1.000s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:46 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2 Jun 23 12:41:46 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:47 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2d849a92-6cf1-498b-aaf3-3713138302c2" returned: 0 in 0.897s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Lock "cinder-quobyte-2d849a92-6cf1-498b-aaf3-3713138302c2" released by "delete_volume" :: held 1.967s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:47 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Created reservations ['b869acc8-efb0-4872-8948-36f615acd551', 'bacc5892-ba86-444a-96aa-11a2d4c1a55c', 'ae471cba-22ac-410e-a48f-2f423bf9ab11', '5631be7a-0dcc-409b-8172-72a46ea15947'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:48 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:41:48 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:41:48 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.853s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:41:48 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Deleted volume successfully. Jun 23 12:41:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7944faab-b62c-46bd-a140-843d300bebda tempest-ServerActionsTestOtherA-473957467 None] Lock "cinder-2d849a92-6cf1-498b-aaf3-3713138302c2-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:41:57 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=35,cinder:INSERT=11,cinder:UPDATE=55,cinder:DELETE=5 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:41:58 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=49,cinder:SELECT=34,cinder:INSERT=13,cinder:DELETE=4 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:41:58 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Flow 'volume_create_manager' (86d410ef-df46-432b-81ce-e7aa26a91256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f909562a-bb4b-41d4-bf4e-603a8325b735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f909562a-bb4b-41d4-bf4e-603a8325b735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1765411374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547c31f2fe3344cd97ea5d8dcf934adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:59Z,use_quota=True,user_id='3366139f25e2469c8d005580fa24fedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121d5d8-e70a-4605-8a31-07be128667c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a121d5d8-e70a-4605-8a31-07be128667c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871532c4-d340-4744-b062-40642e58d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871532c4-d340-4744-b062-40642e58d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4', 'volume_name': 'volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff07437-f588-4cb4-9efd-edbc3bc82051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff07437-f588-4cb4-9efd-edbc3bc82051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081787ca-c2a5-44ce-aa03-0ef9571b9a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:41:59 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Volume 9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4', 'volume_size': 1} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1765411374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='547c31f2fe3344cd97ea5d8dcf934adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:41:59Z,use_quota=True,user_id='3366139f25e2469c8d005580fa24fedb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Creating volume 9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:41:59 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:41:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:41:59 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 1073741824 Jun 23 12:41:59 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:00 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 1073741824" returned: 0 in 1.106s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:00 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 Jun 23 12:42:00 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:01 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4" returned: 0 in 0.995s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:42:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081787ca-c2a5-44ce-aa03-0ef9571b9a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b10491b-26e9-4614-bfdf-fd4bfa91ab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Volume volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 (9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4): created successfully Jun 23 12:42:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b10491b-26e9-4614-bfdf-fd4bfa91ab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Flow 'volume_create_manager' (86d410ef-df46-432b-81ce-e7aa26a91256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-77724a6b-6f74-47cd-87aa-bf352e5d091d tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Created volume successfully. Jun 23 12:42:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Acquiring lock "cinder-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:42:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "cinder-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:42:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Acquiring lock "cinder-quobyte-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:42:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "cinder-quobyte-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:42:03 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[869f96f2-1a8a-4f4b-b8ce-739d46383ce7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:42:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:03 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 Jun 23 12:42:03 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:04 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4" returned: 0 in 0.947s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:04 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4 Jun 23 12:42:04 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:05 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4" returned: 0 in 0.898s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "cinder-quobyte-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4" released by "delete_volume" :: held 1.898s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Created reservations ['175ceaf8-943f-4f4f-af52-12c4c6b99109', '812703c3-2225-4657-8adc-8ed63552d3c9', 'e1ff6701-6eb8-4708-a58f-6e207738e64f', '3abc3c98-0205-4d11-a0e4-8863972a4313'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:05 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:42:05 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:06 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.838s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:06 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:42:06 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Deleted volume successfully. Jun 23 12:42:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0098ebbe-9436-4c3a-ad3c-21ee56e8109b tempest-VolumeQuotasNegativeTestJSON-1672244296 None] Lock "cinder-9ee38d10-3d41-4b63-ae9b-7d5aaa2781d4-delete_volume" released by "delete_volume" :: held 2.991s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Flow 'volume_create_manager' (31409568-e770-4154-a7a6-e4631eb8eb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c6c788-475d-4ca8-8320-5d7050d06ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2c6c788-475d-4ca8-8320-5d7050d06ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-471567331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2241be4b-1e4d-4364-886d-478bec7f58bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5745132eae1453b9dfc33b18e119277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:09Z,use_quota=True,user_id='f0197e630284415fb1749d1abe68d7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db900d3c-5c60-460b-99c1-81438cca773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db900d3c-5c60-460b-99c1-81438cca773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437e00e3-7d6f-4306-98e1-4c73fd268647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437e00e3-7d6f-4306-98e1-4c73fd268647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2241be4b-1e4d-4364-886d-478bec7f58bb', 'volume_name': 'volume-2241be4b-1e4d-4364-886d-478bec7f58bb', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4b9b3b-ac84-4665-97cc-0be095da9af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b4b9b3b-ac84-4665-97cc-0be095da9af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb7e967-1d70-4a97-8187-8a0da4c68ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:09 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Volume 2241be4b-1e4d-4364-886d-478bec7f58bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2241be4b-1e4d-4364-886d-478bec7f58bb', 'volume_size': 1} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-471567331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2241be4b-1e4d-4364-886d-478bec7f58bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5745132eae1453b9dfc33b18e119277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:09Z,use_quota=True,user_id='f0197e630284415fb1749d1abe68d7aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Creating volume 2241be4b-1e4d-4364-886d-478bec7f58bb {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:42:09 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:42:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:09 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb 1073741824 Jun 23 12:42:09 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:10 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb 1073741824" returned: 0 in 1.258s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:10 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb Jun 23 12:42:10 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:11 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb" returned: 0 in 0.978s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] <== create_volume: return (2337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:42:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.339s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb7e967-1d70-4a97-8187-8a0da4c68ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2241be4b-1e4d-4364-886d-478bec7f58bb', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d55efb7-e95a-43b6-89dc-3c0072e74d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Volume volume-2241be4b-1e4d-4364-886d-478bec7f58bb (2241be4b-1e4d-4364-886d-478bec7f58bb): created successfully Jun 23 12:42:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d55efb7-e95a-43b6-89dc-3c0072e74d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Flow 'volume_create_manager' (31409568-e770-4154-a7a6-e4631eb8eb43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6c0bd0b2-f618-4b4c-99bb-af3e0bab4c11 tempest-TaggedAttachmentsTest-2081602439 None] Created volume successfully. Jun 23 12:42:16 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:42:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Flow 'volume_create_manager' (0d91582b-78eb-4bd4-b044-4cf0c0178fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3959420-5548-4bf7-bc62-3b1cb424d8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3959420-5548-4bf7-bc62-3b1cb424d8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-818262938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2b3698-5e44-48e3-a1b3-67e944f0883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be8f8e0c9824491b8f57f1d009e7035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:17Z,use_quota=True,user_id='56280553c07d48ea9a047a728c75450f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1004cf8-9798-427a-8e07-11e8157ca8e8),volume_type_id=a1004cf8-9798-427a-8e07-11e8157ca8e8)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db6eaf3-3632-449b-8c81-76ddd4a54e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db6eaf3-3632-449b-8c81-76ddd4a54e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4199bf7-1673-4c2c-a600-10301b089f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4199bf7-1673-4c2c-a600-10301b089f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2b3698-5e44-48e3-a1b3-67e944f0883b', 'volume_name': 'volume-da2b3698-5e44-48e3-a1b3-67e944f0883b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f1c8a8-5c53-4804-ab38-b2613dc2a6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64f1c8a8-5c53-4804-ab38-b2613dc2a6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c95f1ed-d982-43ea-8f07-f669b4517a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:17 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Volume da2b3698-5e44-48e3-a1b3-67e944f0883b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2b3698-5e44-48e3-a1b3-67e944f0883b', 'volume_size': 1} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-818262938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2b3698-5e44-48e3-a1b3-67e944f0883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2be8f8e0c9824491b8f57f1d009e7035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:17Z,use_quota=True,user_id='56280553c07d48ea9a047a728c75450f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1004cf8-9798-427a-8e07-11e8157ca8e8),volume_type_id=a1004cf8-9798-427a-8e07-11e8157ca8e8)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Creating volume da2b3698-5e44-48e3-a1b3-67e944f0883b {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:42:17 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:42:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:17 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b 1073741824 Jun 23 12:42:17 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:18 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b 1073741824" returned: 0 in 1.086s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:18 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b Jun 23 12:42:18 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:18 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b" returned: 0 in 0.656s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c95f1ed-d982-43ea-8f07-f669b4517a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2b3698-5e44-48e3-a1b3-67e944f0883b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241a14e2-d762-478e-a7df-468e2829c24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:18 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Volume volume-da2b3698-5e44-48e3-a1b3-67e944f0883b (da2b3698-5e44-48e3-a1b3-67e944f0883b): created successfully Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241a14e2-d762-478e-a7df-468e2829c24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Flow 'volume_create_manager' (0d91582b-78eb-4bd4-b044-4cf0c0178fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b5062c41-f74f-4775-a253-208fb61f1f17 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Created volume successfully. Jun 23 12:42:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:19 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:42:19 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:20 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.652s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:42:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-79ca56b6-2669-4929-8749-083e9f2ceb63 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Retype volume completed successfully. Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Acquiring lock "cinder-da2b3698-5e44-48e3-a1b3-67e944f0883b-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "cinder-da2b3698-5e44-48e3-a1b3-67e944f0883b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Acquiring lock "cinder-quobyte-da2b3698-5e44-48e3-a1b3-67e944f0883b" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "cinder-quobyte-da2b3698-5e44-48e3-a1b3-67e944f0883b" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[451dd43e-9885-4b0f-82c8-645c2e290386]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:42:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:20 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b Jun 23 12:42:20 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:21 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b" returned: 0 in 0.840s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:21 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b Jun 23 12:42:21 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:22 devstack sudo[97550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:42:22 devstack sudo[97550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:22 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2b3698-5e44-48e3-a1b3-67e944f0883b" returned: 0 in 1.073s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "cinder-quobyte-da2b3698-5e44-48e3-a1b3-67e944f0883b" released by "delete_volume" :: held 1.980s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:42:22 devstack cinder-volume[93659]: WARNING cinder.quota [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:42:22 devstack cinder-volume[93659]: WARNING cinder.quota [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Created reservations ['a548b239-c8ab-4674-843e-c905f8ca42f4', 'dd812d94-91f1-4425-89c7-fd208fdcd12d', '6689e397-e5d5-400d-9b87-a51be7745160', 'b7de4b5b-10f0-4a41-8c9d-4e010da8c74a'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:23 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:42:23 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:23 devstack sudo[97550]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.915s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:42:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:42:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 8 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:42:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:42:24 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.093s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:24 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:42:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Deleted volume successfully. Jun 23 12:42:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a1d14903-264c-46f2-90a5-c2fd87fd53b2 tempest-VolumeRetypeWithoutMigrationTest-467464214 None] Lock "cinder-da2b3698-5e44-48e3-a1b3-67e944f0883b-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Flow 'volume_create_manager' (63aa84fa-2bfc-49d6-97d9-7a8a618223ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6916d4-002b-4d73-97e4-03ba99121969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6916d4-002b-4d73-97e4-03ba99121969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-695840582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2dd742-adfa-469b-8ed1-22229b32d3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac52ddd6fa0640189584908ccb5f6dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:32Z,use_quota=True,user_id='94ee49a0c29d4525bc57a0f5c244ed43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc704fb0-3e5c-409c-b0f6-d105e4177f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc704fb0-3e5c-409c-b0f6-d105e4177f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e13531-6f81-45f8-8957-5e9094304328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e13531-6f81-45f8-8957-5e9094304328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2dd742-adfa-469b-8ed1-22229b32d3a0', 'volume_name': 'volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b3ec89-913d-41b3-ad68-6212a3bd2345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88b3ec89-913d-41b3-ad68-6212a3bd2345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd9185b-f29b-4685-be4b-db309f0dec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:32 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Volume 6b2dd742-adfa-469b-8ed1-22229b32d3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0', 'volume_size': 1} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-695840582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2dd742-adfa-469b-8ed1-22229b32d3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac52ddd6fa0640189584908ccb5f6dc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:32Z,use_quota=True,user_id='94ee49a0c29d4525bc57a0f5c244ed43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Creating volume 6b2dd742-adfa-469b-8ed1-22229b32d3a0 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:42:32 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:42:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:32 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 1073741824 Jun 23 12:42:32 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:33 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 1073741824" returned: 0 in 1.205s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:33 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 Jun 23 12:42:33 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:34 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0" returned: 0 in 1.073s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:42:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.355s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd9185b-f29b-4685-be4b-db309f0dec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdad607-82af-42c3-b9ba-d25837cb7f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:34 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Volume volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 (6b2dd742-adfa-469b-8ed1-22229b32d3a0): created successfully Jun 23 12:42:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acdad607-82af-42c3-b9ba-d25837cb7f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Flow 'volume_create_manager' (63aa84fa-2bfc-49d6-97d9-7a8a618223ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b80f3f41-862f-4b76-be12-488eac7d93b4 tempest-VolumesServicesTestJSON-1875654495 None] Created volume successfully. Jun 23 12:42:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Acquiring lock "cinder-6b2dd742-adfa-469b-8ed1-22229b32d3a0-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:42:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Lock "cinder-6b2dd742-adfa-469b-8ed1-22229b32d3a0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:42:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Acquiring lock "cinder-quobyte-6b2dd742-adfa-469b-8ed1-22229b32d3a0" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:42:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Lock "cinder-quobyte-6b2dd742-adfa-469b-8ed1-22229b32d3a0" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:42:36 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04c432c-1a73-47bb-9fe3-b3579b389b9b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:42:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:36 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 Jun 23 12:42:36 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:37 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0" returned: 0 in 1.649s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:37 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0 Jun 23 12:42:37 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:38 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6b2dd742-adfa-469b-8ed1-22229b32d3a0" returned: 0 in 0.888s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Lock "cinder-quobyte-6b2dd742-adfa-469b-8ed1-22229b32d3a0" released by "delete_volume" :: held 2.598s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Created reservations ['4dee0e23-61f9-4c81-a021-4e2435d09ef0', '6c855b8b-7341-40d8-88aa-46ea55162a1a', '374fa07b-d0e8-4682-9a11-ab60a3e1a551', '834fdd1b-c044-4536-8f9e-d63af074ad89'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:38 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:42:38 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:40 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.719s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:40 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:42:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Deleted volume successfully. Jun 23 12:42:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7dd5032b-a22b-4016-b750-272a3626eced tempest-VolumesServicesTestJSON-1875654495 None] Lock "cinder-6b2dd742-adfa-469b-8ed1-22229b32d3a0-delete_volume" released by "delete_volume" :: held 4.711s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:42:48 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=36,cinder:SELECT=29,cinder:INSERT=9,cinder:DELETE=4 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:42:50 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=32,cinder:UPDATE=46,cinder:INSERT=7,cinder:DELETE=3 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Flow 'volume_create_manager' (fd40cb76-f18f-4b62-9b74-f0d348a760c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd1ff17-897f-4c79-881c-d2009ac5c388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd1ff17-897f-4c79-881c-d2009ac5c388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731361754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20a97bb-4e42-4d25-9c9b-bccf76a85d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035befc789454893936fa111ef8436f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:56Z,use_quota=True,user_id='2859d5ada4dd4f2086f13cb521904c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af716a32-8f78-4080-b495-e1206d13096c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af716a32-8f78-4080-b495-e1206d13096c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9846abd8-adf8-4b3c-9d9d-3f290bed4b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9846abd8-adf8-4b3c-9d9d-3f290bed4b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20a97bb-4e42-4d25-9c9b-bccf76a85d51', 'volume_name': 'volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1414e860-0cb9-410c-927c-987080227367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1414e860-0cb9-410c-927c-987080227367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f15937-656a-49e9-8b15-4ad66bed4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:55 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Volume d20a97bb-4e42-4d25-9c9b-bccf76a85d51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51', 'volume_size': 1} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731361754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20a97bb-4e42-4d25-9c9b-bccf76a85d51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035befc789454893936fa111ef8436f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:56Z,use_quota=True,user_id='2859d5ada4dd4f2086f13cb521904c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Creating volume d20a97bb-4e42-4d25-9c9b-bccf76a85d51 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:42:55 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:42:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:55 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 1073741824 Jun 23 12:42:55 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:56 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 1073741824" returned: 0 in 0.966s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:56 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 Jun 23 12:42:56 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:57 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51" returned: 0 in 0.706s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:42:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f15937-656a-49e9-8b15-4ad66bed4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d1c2c3-dff5-4a53-a65b-7b4bb5bdc842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:57 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Volume volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 (d20a97bb-4e42-4d25-9c9b-bccf76a85d51): created successfully Jun 23 12:42:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d1c2c3-dff5-4a53-a65b-7b4bb5bdc842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Flow 'volume_create_manager' (fd40cb76-f18f-4b62-9b74-f0d348a760c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-778e2d62-2fa3-4423-8a80-a8fa54ac7eec tempest-VolumesListAdminTestJSON-367868651 None] Created volume successfully. Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Flow 'volume_create_manager' (cf889213-1029-4ea8-a5d2-8073d43298ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7657bf24-be02-45d3-965f-bdd91ab57ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7657bf24-be02-45d3-965f-bdd91ab57ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1693356562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ae8770-d31a-4b91-a967-40f0e0449252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035befc789454893936fa111ef8436f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:58Z,use_quota=True,user_id='2859d5ada4dd4f2086f13cb521904c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c835e067-3e5e-4e83-9e6e-312834014fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c835e067-3e5e-4e83-9e6e-312834014fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5675f74-1822-45f1-9fcf-d6f0b9cb42cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5675f74-1822-45f1-9fcf-d6f0b9cb42cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42ae8770-d31a-4b91-a967-40f0e0449252', 'volume_name': 'volume-42ae8770-d31a-4b91-a967-40f0e0449252', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a62883-fef7-4f2d-afb4-a93eb9de5a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a62883-fef7-4f2d-afb4-a93eb9de5a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5adfef-c3f9-4af2-98da-4e596aa2450d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:42:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Volume 42ae8770-d31a-4b91-a967-40f0e0449252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42ae8770-d31a-4b91-a967-40f0e0449252', 'volume_size': 1} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1693356562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42ae8770-d31a-4b91-a967-40f0e0449252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035befc789454893936fa111ef8436f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:42:58Z,use_quota=True,user_id='2859d5ada4dd4f2086f13cb521904c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Creating volume 42ae8770-d31a-4b91-a967-40f0e0449252 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:42:58 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:42:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:58 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 1073741824 Jun 23 12:42:58 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:42:59 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Jun 23 12:42:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 1073741824" returned: 0 in 0.945s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:42:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:42:59 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 Jun 23 12:42:59 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:00 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252" returned: 0 in 0.677s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:43:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5adfef-c3f9-4af2-98da-4e596aa2450d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42ae8770-d31a-4b91-a967-40f0e0449252', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7892de-077b-460e-8dd0-3d80ce3f4542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Volume volume-42ae8770-d31a-4b91-a967-40f0e0449252 (42ae8770-d31a-4b91-a967-40f0e0449252): created successfully Jun 23 12:43:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7892de-077b-460e-8dd0-3d80ce3f4542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Flow 'volume_create_manager' (cf889213-1029-4ea8-a5d2-8073d43298ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:00 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7bc57622-604e-4a90-8b98-b00b54baa171 tempest-VolumesListAdminTestJSON-367868651 None] Created volume successfully. Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Flow 'volume_create_manager' (a86d55d9-845f-4ab4-88fd-f7c94177fcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66241de-5813-4225-b075-176856ac9d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b66241de-5813-4225-b075-176856ac9d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2027499919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f370470e-8b69-4906-b51a-838c72d828a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035befc789454893936fa111ef8436f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:01Z,use_quota=True,user_id='2859d5ada4dd4f2086f13cb521904c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501a40c5-f7b5-4c17-bd27-26e1e65579da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501a40c5-f7b5-4c17-bd27-26e1e65579da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02239977-f22d-4d78-9513-d8f4989f84c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02239977-f22d-4d78-9513-d8f4989f84c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f370470e-8b69-4906-b51a-838c72d828a3', 'volume_name': 'volume-f370470e-8b69-4906-b51a-838c72d828a3', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4fe8b-5afe-488c-b5e8-ac063607d57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc4fe8b-5afe-488c-b5e8-ac063607d57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312f2649-0db4-42d0-8834-481524c24214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Volume f370470e-8b69-4906-b51a-838c72d828a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f370470e-8b69-4906-b51a-838c72d828a3', 'volume_size': 1} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2027499919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f370470e-8b69-4906-b51a-838c72d828a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035befc789454893936fa111ef8436f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:01Z,use_quota=True,user_id='2859d5ada4dd4f2086f13cb521904c31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Creating volume f370470e-8b69-4906-b51a-838c72d828a3 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:43:01 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:43:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:01 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 1073741824 Jun 23 12:43:01 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:02 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 1073741824" returned: 0 in 1.049s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Flow 'volume_create_manager' (3d8ebe57-6aec-40eb-be56-430e9a4b7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54082f14-bb05-4c95-b2ba-72a001e7f540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:02 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 Jun 23 12:43:02 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54082f14-bb05-4c95-b2ba-72a001e7f540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1465942711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb4401c-85ad-44f6-b6c0-f5f724132853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fa691aa288433aa958ad3233f94d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:02Z,use_quota=True,user_id='cffafa4834624506ac5e34fb15d3242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca67b9f-08dc-4c5e-a564-00191e9cc376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca67b9f-08dc-4c5e-a564-00191e9cc376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4427e4a-b19c-4a68-9a0f-26f6990c83ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4427e4a-b19c-4a68-9a0f-26f6990c83ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb4401c-85ad-44f6-b6c0-f5f724132853', 'volume_name': 'volume-2cb4401c-85ad-44f6-b6c0-f5f724132853', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36102aef-25bd-435c-b7c7-e10f5bd7c04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36102aef-25bd-435c-b7c7-e10f5bd7c04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625a9e14-55be-49bb-b78e-1255ccb11b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:02 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Volume 2cb4401c-85ad-44f6-b6c0-f5f724132853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb4401c-85ad-44f6-b6c0-f5f724132853', 'volume_size': 1} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:02 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3" returned: 0 in 0.681s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1465942711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb4401c-85ad-44f6-b6c0-f5f724132853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78fa691aa288433aa958ad3233f94d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:02Z,use_quota=True,user_id='cffafa4834624506ac5e34fb15d3242b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Creating volume 2cb4401c-85ad-44f6-b6c0-f5f724132853 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:43:02 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:02 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 1073741824 Jun 23 12:43:02 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312f2649-0db4-42d0-8834-481524c24214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f370470e-8b69-4906-b51a-838c72d828a3', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7e4bb3-7870-49d6-82da-26e631b9d875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Volume volume-f370470e-8b69-4906-b51a-838c72d828a3 (f370470e-8b69-4906-b51a-838c72d828a3): created successfully Jun 23 12:43:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7e4bb3-7870-49d6-82da-26e631b9d875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Flow 'volume_create_manager' (a86d55d9-845f-4ab4-88fd-f7c94177fcc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-09ee64cf-d161-4512-bd0c-51c95cefe0f1 tempest-VolumesListAdminTestJSON-367868651 None] Created volume successfully. Jun 23 12:43:03 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 1073741824" returned: 0 in 0.948s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:03 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:43:03 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 Jun 23 12:43:03 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Flow 'volume_create_manager' (fc662473-cb29-4c7b-889b-90aa2dbcbc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d17d6c0-2996-4196-b163-05a566f43b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d17d6c0-2996-4196-b163-05a566f43b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5f6d76-3108-4e40-8dab-0ac9e322746d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126728141ca04b79877d1e5d515fdd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:04Z,use_quota=True,user_id='e9d32143c4114435a68246c3fa44e277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b7ab18-090e-4f89-9cff-a68451db10e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b7ab18-090e-4f89-9cff-a68451db10e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad312f1d-f669-4915-b99b-a962e5f8bb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad312f1d-f669-4915-b99b-a962e5f8bb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb5f6d76-3108-4e40-8dab-0ac9e322746d', 'volume_name': 'volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4bd6e7-558a-489e-8d89-5a55d0ee44fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4bd6e7-558a-489e-8d89-5a55d0ee44fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b46d34-0cdf-4609-86b0-b04958c2c0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:04 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Volume eb5f6d76-3108-4e40-8dab-0ac9e322746d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d', 'volume_size': 1} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:04 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853" returned: 0 in 0.629s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb5f6d76-3108-4e40-8dab-0ac9e322746d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126728141ca04b79877d1e5d515fdd24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:04Z,use_quota=True,user_id='e9d32143c4114435a68246c3fa44e277',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Creating volume eb5f6d76-3108-4e40-8dab-0ac9e322746d {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:43:04 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:04 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d 1073741824 Jun 23 12:43:04 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625a9e14-55be-49bb-b78e-1255ccb11b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb4401c-85ad-44f6-b6c0-f5f724132853', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68943457-0dac-483f-8d59-ad4da96388db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:04 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Volume volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 (2cb4401c-85ad-44f6-b6c0-f5f724132853): created successfully Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68943457-0dac-483f-8d59-ad4da96388db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Flow 'volume_create_manager' (3d8ebe57-6aec-40eb-be56-430e9a4b7445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:04 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e8f0af23-2d71-4925-bc96-0bca228af32f tempest-AttachVolumeShelveTestJSON-1804914398 None] Created volume successfully. Jun 23 12:43:05 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d 1073741824" returned: 0 in 0.927s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:05 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d Jun 23 12:43:05 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:06 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d" returned: 0 in 0.703s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:43:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b46d34-0cdf-4609-86b0-b04958c2c0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0312185c-6a2f-4267-9807-81ad1cf5f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:06 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Volume volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d (eb5f6d76-3108-4e40-8dab-0ac9e322746d): created successfully Jun 23 12:43:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0312185c-6a2f-4267-9807-81ad1cf5f29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Flow 'volume_create_manager' (fc662473-cb29-4c7b-889b-90aa2dbcbc54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:06 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-931f54d9-2a8e-4c48-a3dd-6abcf8027838 tempest-VolumesListAdminTestJSON-265461653 None] Created volume successfully. Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Acquiring lock "cinder-eb5f6d76-3108-4e40-8dab-0ac9e322746d-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Lock "cinder-eb5f6d76-3108-4e40-8dab-0ac9e322746d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Acquiring lock "cinder-quobyte-eb5f6d76-3108-4e40-8dab-0ac9e322746d" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Lock "cinder-quobyte-eb5f6d76-3108-4e40-8dab-0ac9e322746d" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6205d36-c7d8-44d8-813a-045f2bd3386b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "cinder-f370470e-8b69-4906-b51a-838c72d828a3-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-f370470e-8b69-4906-b51a-838c72d828a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "cinder-quobyte-f370470e-8b69-4906-b51a-838c72d828a3" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-quobyte-f370470e-8b69-4906-b51a-838c72d828a3" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:07 devstack sudo[98120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d Jun 23 12:43:07 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[32649cb0-5d93-4188-8b7d-3509513d46ea]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:07 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 Jun 23 12:43:07 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:08 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d" returned: 0 in 0.858s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:08 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d Jun 23 12:43:08 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:08 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3" returned: 0 in 0.820s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:08 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3 Jun 23 12:43:08 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:09 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eb5f6d76-3108-4e40-8dab-0ac9e322746d" returned: 0 in 0.935s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Lock "cinder-quobyte-eb5f6d76-3108-4e40-8dab-0ac9e322746d" released by "delete_volume" :: held 1.835s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:09 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f370470e-8b69-4906-b51a-838c72d828a3" returned: 0 in 0.854s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-quobyte-f370470e-8b69-4906-b51a-838c72d828a3" released by "delete_volume" :: held 1.721s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Created reservations ['b29c01b8-2eb2-4213-8c76-81b6e01f11d2', '6ff13e5a-76b2-4520-aeb2-edf558ad6597', '184bdd48-c993-4b7b-ae45-6a186822bc0b', 'd3faed94-4e1f-4b73-b862-8aed7390007e'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Created reservations ['2275878e-b634-430b-9e0b-f88365717bbc', '4dcb439c-5204-4251-8f11-ab187f531b15', 'd2f536f8-1ffc-41ba-83e4-4b08f9343d0b', 'a3f84fc2-b644-48b4-ac3b-4fb158ddff49'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:09 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:09 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:09 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:09 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "cinder-42ae8770-d31a-4b91-a967-40f0e0449252-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-42ae8770-d31a-4b91-a967-40f0e0449252-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "cinder-quobyte-42ae8770-d31a-4b91-a967-40f0e0449252" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-quobyte-42ae8770-d31a-4b91-a967-40f0e0449252" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09059d9-e3d3-421a-8a37-1bdaf5c02ea6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:10 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.799s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Deleted volume successfully. Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8d8388fb-f756-41fa-b246-1ed2ca5b28ef tempest-VolumesListAdminTestJSON-265461653 None] Lock "cinder-eb5f6d76-3108-4e40-8dab-0ac9e322746d-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:10 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 Jun 23 12:43:10 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:10 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.849s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Deleted volume successfully. Jun 23 12:43:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d09142b5-8686-4f98-878f-f4944bf3cc1d tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-f370470e-8b69-4906-b51a-838c72d828a3-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:11 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252" returned: 0 in 1.074s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:11 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252 Jun 23 12:43:11 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:12 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-42ae8770-d31a-4b91-a967-40f0e0449252" returned: 0 in 1.096s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-quobyte-42ae8770-d31a-4b91-a967-40f0e0449252" released by "delete_volume" :: held 2.225s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Created reservations ['3496811b-282c-42c4-b762-dfa42e70998f', '54724283-d626-4e5a-8bfc-7eb884c160da', '4d7eb7a6-2205-4fb7-a6bd-c439d16f993f', '20a3da5a-f8b9-4297-b375-ebf5e4e5de09'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:12 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:12 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:13 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.825s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:13 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Deleted volume successfully. Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-819739b8-8123-4135-9dc5-2a61f8212ef3 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-42ae8770-d31a-4b91-a967-40f0e0449252-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "cinder-d20a97bb-4e42-4d25-9c9b-bccf76a85d51-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-d20a97bb-4e42-4d25-9c9b-bccf76a85d51-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "cinder-quobyte-d20a97bb-4e42-4d25-9c9b-bccf76a85d51" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-quobyte-d20a97bb-4e42-4d25-9c9b-bccf76a85d51" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2056c2f-0d9c-4d04-8a1a-83ab8a27d17a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:13 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 Jun 23 12:43:13 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:14 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51" returned: 0 in 0.771s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:14 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51 Jun 23 12:43:14 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:15 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d20a97bb-4e42-4d25-9c9b-bccf76a85d51" returned: 0 in 0.666s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-quobyte-d20a97bb-4e42-4d25-9c9b-bccf76a85d51" released by "delete_volume" :: held 1.479s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Created reservations ['11dd73ca-1301-45e5-9688-2ffdf56f9c36', 'ceba7889-5784-40d0-b326-9a22ba15dcc6', '2f0e727b-84bf-4ce1-86e7-bb5871cb2e09', 'a7482876-f86c-4649-9654-d7d661547369'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:15 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:15 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:15 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.696s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:15 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:15 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Deleted volume successfully. Jun 23 12:43:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82e446de-e8aa-4bf1-b38d-54639398fad0 tempest-VolumesListAdminTestJSON-367868651 None] Lock "cinder-d20a97bb-4e42-4d25-9c9b-bccf76a85d51-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Flow 'volume_create_manager' (0e32589d-ce65-4d96-a32a-0e5040ec620e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3251a-ebbf-4212-8f5d-bdc9b6234b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3251a-ebbf-4212-8f5d-bdc9b6234b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-488039111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bb07a6-f7aa-4614-9e10-ab9b0909afa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7338e3c17e044fc937d44421d783283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:17Z,use_quota=True,user_id='7f2f037980874b7c929ed13e0d85714b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6cc30b-c547-483d-b92a-f6a615c483dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6cc30b-c547-483d-b92a-f6a615c483dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ddaad3-2ba7-4262-9f3a-3bfe430e913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ddaad3-2ba7-4262-9f3a-3bfe430e913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bb07a6-f7aa-4614-9e10-ab9b0909afa8', 'volume_name': 'volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e50582e-7043-45af-be7a-d342fadfd932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e50582e-7043-45af-be7a-d342fadfd932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41e56fb-04db-4d63-bd55-3a4769cea7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:17 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Volume 16bb07a6-f7aa-4614-9e10-ab9b0909afa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8', 'volume_size': 1} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-488039111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bb07a6-f7aa-4614-9e10-ab9b0909afa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7338e3c17e044fc937d44421d783283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:17Z,use_quota=True,user_id='7f2f037980874b7c929ed13e0d85714b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Creating volume 16bb07a6-f7aa-4614-9e10-ab9b0909afa8 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:43:17 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:43:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:17 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 1073741824 Jun 23 12:43:17 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-40bd0d42-8ddc-4424-ad32-0498521dc12f req-747b38e5-7cb8-4770-a00d-e60bca359e97 tempest-TaggedAttachmentsTest-2081602439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:18 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 1073741824" returned: 0 in 1.099s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:18 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 Jun 23 12:43:18 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:19 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8" returned: 0 in 0.679s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-40bd0d42-8ddc-4424-ad32-0498521dc12f req-747b38e5-7cb8-4770-a00d-e60bca359e97 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.159s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41e56fb-04db-4d63-bd55-3a4769cea7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae27af3a-3b67-4dd0-bea3-1c0e7fb370df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb4d448-d848-4da6-811e-e72cac9a26a1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-40bd0d42-8ddc-4424-ad32-0498521dc12f req-747b38e5-7cb8-4770-a00d-e60bca359e97 tempest-TaggedAttachmentsTest-2081602439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:19 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Volume volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 (16bb07a6-f7aa-4614-9e10-ab9b0909afa8): created successfully Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae27af3a-3b67-4dd0-bea3-1c0e7fb370df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Flow 'volume_create_manager' (0e32589d-ce65-4d96-a32a-0e5040ec620e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e163d0b1-98dc-4e05-9ca3-da047c7cb4ad tempest-AttachVolumeNegativeTest-1678089407 None] Created volume successfully. Jun 23 12:43:19 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb Jun 23 12:43:19 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:20 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-40bd0d42-8ddc-4424-ad32-0498521dc12f req-747b38e5-7cb8-4770-a00d-e60bca359e97 tempest-TaggedAttachmentsTest-2081602439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb" returned: 0 in 0.892s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-40bd0d42-8ddc-4424-ad32-0498521dc12f req-747b38e5-7cb8-4770-a00d-e60bca359e97 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.919s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-40bd0d42-8ddc-4424-ad32-0498521dc12f req-747b38e5-7cb8-4770-a00d-e60bca359e97 tempest-TaggedAttachmentsTest-2081602439 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-2241be4b-1e4d-4364-886d-478bec7f58bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7660f8c4-dbe5-481c-9ba4-1c261d15ad0b', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:43:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-40bd0d42-8ddc-4424-ad32-0498521dc12f req-747b38e5-7cb8-4770-a00d-e60bca359e97 tempest-TaggedAttachmentsTest-2081602439 None] attachment_update completed successfully. Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-0ae12c42-f0b0-4506-956a-e000a585f047 req-218d9eb4-743c-4cd9-b9ef-69ebaf770faf tempest-AttachVolumeShelveTestJSON-1804914398 None] No connector for attachment 6510bcad-d619-487c-bdb9-87607e61b3cb; skipping storage backend terminate_connection call. {{(pid=93659) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-0ae12c42-f0b0-4506-956a-e000a585f047 req-218d9eb4-743c-4cd9-b9ef-69ebaf770faf tempest-AttachVolumeShelveTestJSON-1804914398 None] Deleting attachment 6510bcad-d619-487c-bdb9-87607e61b3cb. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:22 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:22 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:22 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.665s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 8 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:43:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Flow 'volume_create_manager' (158d3c26-89f3-4ec0-8920-c71e2c6e0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779406f6-b987-44b2-a5fa-5c5e0dfbdecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (779406f6-b987-44b2-a5fa-5c5e0dfbdecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1382507043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f36dbb-208a-400c-8d22-8de5fa375df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543054e3b8594bf8b01c6169bec06ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:24Z,use_quota=True,user_id='66fa444106e643988e45619a6865cd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ba26e8-a698-41d3-abfe-e66348e860f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ba26e8-a698-41d3-abfe-e66348e860f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d934b5-0fd7-422f-be71-e6570a59c0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a35ed984-db12-4a03-9397-a8f73de24525 req-172bc969-dc22-40c9-8744-0bed2d8fb773 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a35ed984-db12-4a03-9397-a8f73de24525 req-172bc969-dc22-40c9-8744-0bed2d8fb773 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea771e0-dead-43d5-8767-d6a0d7255078]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-a35ed984-db12-4a03-9397-a8f73de24525 req-172bc969-dc22-40c9-8744-0bed2d8fb773 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:24 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 Jun 23 12:43:24 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51d934b5-0fd7-422f-be71-e6570a59c0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82f36dbb-208a-400c-8d22-8de5fa375df6', 'volume_name': 'volume-82f36dbb-208a-400c-8d22-8de5fa375df6', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560dea0d-3037-459e-b3e0-f7ca02465c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (560dea0d-3037-459e-b3e0-f7ca02465c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feed38c3-f588-45e2-91cb-e24b656ffe90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Volume 82f36dbb-208a-400c-8d22-8de5fa375df6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82f36dbb-208a-400c-8d22-8de5fa375df6', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 12:43:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Trying to clone 82f36dbb-208a-400c-8d22-8de5fa375df6 from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 12:43:25 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Image download 20.69 MB at 20.69 MB/s Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e43f2fe-bb20-4d27-9db6-7060f1ac6fa9]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:25 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:25 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD Jun 23 12:43:25 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-a35ed984-db12-4a03-9397-a8f73de24525 req-172bc969-dc22-40c9-8744-0bed2d8fb773 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8" returned: 0 in 0.979s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a35ed984-db12-4a03-9397-a8f73de24525 req-172bc969-dc22-40c9-8744-0bed2d8fb773 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.999s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-a35ed984-db12-4a03-9397-a8f73de24525 req-172bc969-dc22-40c9-8744-0bed2d8fb773 tempest-AttachVolumeNegativeTest-1678089407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac05f833-97f4-4ad9-b192-df4459c39c3a', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:43:25 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-a35ed984-db12-4a03-9397-a8f73de24525 req-172bc969-dc22-40c9-8744-0bed2d8fb773 tempest-AttachVolumeNegativeTest-1678089407 None] attachment_update completed successfully. Jun 23 12:43:25 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:25 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd is fetched for user 66fa444106e643988e45619a6865cd56. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc07b33-586b-48ca-8463-31af6fbf0f6b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:26 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD Jun 23 12:43:26 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:26 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1382507043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f36dbb-208a-400c-8d22-8de5fa375df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='543054e3b8594bf8b01c6169bec06ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:24Z,use_quota=True,user_id='66fa444106e643988e45619a6865cd56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Creating volume 82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:43:26 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:43:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:26 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 1073741824 Jun 23 12:43:26 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:27 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 1073741824" returned: 0 in 0.800s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:27 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 Jun 23 12:43:27 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-9a992b4e-5fa3-415a-bdb9-ec1795dab4d4 req-dc7dd535-7bed-406f-b4eb-e527360f7831 tempest-TaggedAttachmentsTest-2081602439 None] Terminate volume connection completed successfully. Jun 23 12:43:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-9a992b4e-5fa3-415a-bdb9-ec1795dab4d4 req-dc7dd535-7bed-406f-b4eb-e527360f7831 tempest-TaggedAttachmentsTest-2081602439 None] Deleting attachment 7660f8c4-dbe5-481c-9ba4-1c261d15ad0b. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:43:28 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6" returned: 0 in 0.632s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:43:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:28 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Attempting download of 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume 82f36dbb-208a-400c-8d22-8de5fa375df6. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 12:43:28 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1daa9df-ad1d-4483-99e3-08a55ca51510]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9d7qbqti {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:28 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9d7qbqti Jun 23 12:43:28 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:29 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9d7qbqti" returned: 0 in 0.751s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9d7qbqti {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:29 devstack sudo[98833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9d7qbqti Jun 23 12:43:29 devstack sudo[98833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:29 devstack sudo[98833]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9d7qbqti" returned: 1 in 0.735s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9d7qbqti' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:43:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcb9638-a57f-4d7f-9da7-e527e055a743]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:29 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD Jun 23 12:43:29 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:30 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD" returned: 0 in 0.973s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:30 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd was qcow2, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 12:43:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:30 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 Jun 23 12:43:30 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:33 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6" returned: 0 in 2.556s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:33 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_9njvf27adevstack@QuobyteHD, size 112.00 MB, duration 2.56 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:43:33 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Converted 112.00 MB image at 43.80 MB/s Jun 23 12:43:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:33 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 1G Jun 23 12:43:33 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:34 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 1G" returned: 0 in 0.822s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[37df5e5d-7c9b-4161-a64c-8e6c0efc0115]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:34 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 Jun 23 12:43:34 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:35 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6" returned: 0 in 0.833s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:35 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 Jun 23 12:43:35 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:35 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6" returned: 1 in 0.792s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Downloaded image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume 82f36dbb-208a-400c-8d22-8de5fa375df6 successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd for user 66fa444106e643988e45619a6865cd56 is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Marking volume 82f36dbb-208a-400c-8d22-8de5fa375df6 as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Copying metadata from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd to 82f36dbb-208a-400c-8d22-8de5fa375df6. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 12:43:35 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Creating volume glance metadata for volume 82f36dbb-208a-400c-8d22-8de5fa375df6 backed by image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 12:43:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feed38c3-f588-45e2-91cb-e24b656ffe90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f36dbb-208a-400c-8d22-8de5fa375df6', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc26056f-e5d9-49a1-963b-e56c71f198f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:36 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Volume volume-82f36dbb-208a-400c-8d22-8de5fa375df6 (82f36dbb-208a-400c-8d22-8de5fa375df6): created successfully Jun 23 12:43:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc26056f-e5d9-49a1-963b-e56c71f198f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Flow 'volume_create_manager' (158d3c26-89f3-4ec0-8920-c71e2c6e0344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2c9ca34a-12bb-4a91-a6fb-2d80d2596fc7 tempest-VolumesImageMetadata-1736885289 None] Created volume successfully. Jun 23 12:43:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Acquiring lock "cinder-82f36dbb-208a-400c-8d22-8de5fa375df6-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Lock "cinder-82f36dbb-208a-400c-8d22-8de5fa375df6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Acquiring lock "cinder-quobyte-82f36dbb-208a-400c-8d22-8de5fa375df6" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Lock "cinder-quobyte-82f36dbb-208a-400c-8d22-8de5fa375df6" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:37 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[308c5f54-409f-40e4-954b-41c50a0f1575]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:37 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 Jun 23 12:43:37 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:38 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6" returned: 0 in 1.021s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:38 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 Jun 23 12:43:38 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:39 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6" returned: 1 in 0.834s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:43:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:39 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6 Jun 23 12:43:39 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:40 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-82f36dbb-208a-400c-8d22-8de5fa375df6" returned: 0 in 1.075s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Lock "cinder-quobyte-82f36dbb-208a-400c-8d22-8de5fa375df6" released by "delete_volume" :: held 3.106s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Created reservations ['079c296e-5ba2-49c3-b8da-01e1a2ed6d88', 'a39e66ba-6fc1-40f8-8cc4-b30377bf7fb0', '495aa01b-951d-4424-96d2-8b7386d949f3', '77d7baa5-df82-4f4e-81a4-b1ddc3501c65'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:40 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:40 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:42 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.197s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:42 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Deleted volume successfully. Jun 23 12:43:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-46cdfab6-011f-4e6c-8b0d-510e6991516c tempest-VolumesImageMetadata-1736885289 None] Lock "cinder-82f36dbb-208a-400c-8d22-8de5fa375df6-delete_volume" released by "delete_volume" :: held 4.623s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=66,cinder:SELECT=59,cinder:DELETE=6,cinder:INSERT=23 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Flow 'volume_create_manager' (f83d578e-ec57-4e8b-85d2-c80ae1992f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8521a865-1063-40fa-a360-0bc5f2082b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8521a865-1063-40fa-a360-0bc5f2082b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978720492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522973d7-7a8f-4734-9056-19d9e09f9e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512121348f654c6586d0163171c16468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:49Z,use_quota=True,user_id='5ab456558dfe4adabd85286c9c15e7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580e5190-a479-4d6a-a38a-15b0ec544fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (580e5190-a479-4d6a-a38a-15b0ec544fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57175621-048f-4a54-9020-fd11fc05e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57175621-048f-4a54-9020-fd11fc05e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '522973d7-7a8f-4734-9056-19d9e09f9e8a', 'volume_name': 'volume-522973d7-7a8f-4734-9056-19d9e09f9e8a', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e4de3-3c2d-4ec4-a185-c8c3669c1d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e4de3-3c2d-4ec4-a185-c8c3669c1d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f43dfe-f7ad-4d40-b5b4-5e245dc2f425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:49 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Volume 522973d7-7a8f-4734-9056-19d9e09f9e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-522973d7-7a8f-4734-9056-19d9e09f9e8a', 'volume_size': 1} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1978720492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=522973d7-7a8f-4734-9056-19d9e09f9e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512121348f654c6586d0163171c16468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:43:49Z,use_quota=True,user_id='5ab456558dfe4adabd85286c9c15e7c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Creating volume 522973d7-7a8f-4734-9056-19d9e09f9e8a {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:43:49 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:43:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:49 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a 1073741824 Jun 23 12:43:49 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Acquiring lock "cinder-2241be4b-1e4d-4364-886d-478bec7f58bb-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Lock "cinder-2241be4b-1e4d-4364-886d-478bec7f58bb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Acquiring lock "cinder-quobyte-2241be4b-1e4d-4364-886d-478bec7f58bb" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Lock "cinder-quobyte-2241be4b-1e4d-4364-886d-478bec7f58bb" acquired by "delete_volume" :: waited 0.054s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:50 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de6d6b2-278e-4196-8c71-8ad497eb8d79]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:50 devstack sudo[99223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb Jun 23 12:43:50 devstack sudo[99223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:51 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a 1073741824" returned: 0 in 1.421s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:51 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=62,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=6 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:43:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:51 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a Jun 23 12:43:51 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:51 devstack sudo[99223]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb" returned: 0 in 1.307s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:51 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb Jun 23 12:43:51 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:52 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a" returned: 0 in 1.254s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] <== create_volume: return (2750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.756s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f43dfe-f7ad-4d40-b5b4-5e245dc2f425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-522973d7-7a8f-4734-9056-19d9e09f9e8a', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66e201f-8a97-4cfd-9a1b-53632066289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:43:52 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Volume volume-522973d7-7a8f-4734-9056-19d9e09f9e8a (522973d7-7a8f-4734-9056-19d9e09f9e8a): created successfully Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66e201f-8a97-4cfd-9a1b-53632066289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Flow 'volume_create_manager' (f83d578e-ec57-4e8b-85d2-c80ae1992f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:43:52 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0880af54-afe5-4701-9a89-bcdf84a43bbd tempest-VolumesMetadataTest-1332200041 None] Created volume successfully. Jun 23 12:43:52 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2241be4b-1e4d-4364-886d-478bec7f58bb" returned: 0 in 1.057s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Lock "cinder-quobyte-2241be4b-1e4d-4364-886d-478bec7f58bb" released by "delete_volume" :: held 2.510s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Created reservations ['5009d7c5-e8dd-4781-a169-581bb81c5407', '51468d8c-5f63-4beb-bf3a-b20feb69df5f', '47f88d5e-5c2a-4249-a744-c2a5c7a05a03', '1a38f701-f7fb-4a86-a692-e687bf5871a4'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:53 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:53 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Acquiring lock "cinder-522973d7-7a8f-4734-9056-19d9e09f9e8a-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Lock "cinder-522973d7-7a8f-4734-9056-19d9e09f9e8a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Acquiring lock "cinder-quobyte-522973d7-7a8f-4734-9056-19d9e09f9e8a" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Lock "cinder-quobyte-522973d7-7a8f-4734-9056-19d9e09f9e8a" acquired by "delete_volume" :: waited 0.041s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c5f373-f36e-4494-b06c-2f4db1df28be]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:54 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a Jun 23 12:43:54 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:54 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.545s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Deleted volume successfully. Jun 23 12:43:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6faa6e59-58d2-4430-ad43-af3c1f94b620 tempest-TaggedAttachmentsTest-2081602439 None] Lock "cinder-2241be4b-1e4d-4364-886d-478bec7f58bb-delete_volume" released by "delete_volume" :: held 4.549s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:55 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a" returned: 0 in 1.306s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:55 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a Jun 23 12:43:55 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:56 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-522973d7-7a8f-4734-9056-19d9e09f9e8a" returned: 0 in 0.752s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Lock "cinder-quobyte-522973d7-7a8f-4734-9056-19d9e09f9e8a" released by "delete_volume" :: held 2.117s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Created reservations ['d7908163-2252-4959-83c0-aa31b49aed1a', 'f89d8ce1-a8c2-43a5-8bfe-62b3f73b4943', 'ed402067-b232-40ed-976f-d2b46c3853fd', 'c0ab86a4-afe7-4e30-a3d1-b96f7e2ebe69'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:43:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:43:56 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:43:56 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:43:57 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Jun 23 12:43:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.804s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:43:57 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:43:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Deleted volume successfully. Jun 23 12:43:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2219212d-bc12-458e-9671-ccb328fca70e tempest-VolumesMetadataTest-1332200041 None] Lock "cinder-522973d7-7a8f-4734-9056-19d9e09f9e8a-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Flow 'volume_create_manager' (0b12294e-79e6-476a-b3fa-3d642da92c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1bdbf4-7612-448b-839c-d46cf8ca5ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1bdbf4-7612-448b-839c-d46cf8ca5ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-717926110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955aa90d-a01b-440d-958b-0c3ca2490937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc63eaed6a24acab564f97979a8ebc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:04Z,use_quota=True,user_id='a907e7a68dbf4ab386709caf2431ebda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07f786b-6bc9-44ee-aea2-338011233290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07f786b-6bc9-44ee-aea2-338011233290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0343ee1-de5f-4dbb-9208-b1cf8a179693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0343ee1-de5f-4dbb-9208-b1cf8a179693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '955aa90d-a01b-440d-958b-0c3ca2490937', 'volume_name': 'volume-955aa90d-a01b-440d-958b-0c3ca2490937', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea0dc5e-c25a-464f-9c0e-ddabad213f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea0dc5e-c25a-464f-9c0e-ddabad213f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07625771-84c2-4700-b690-999ddad047cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:04 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Volume 955aa90d-a01b-440d-958b-0c3ca2490937: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-955aa90d-a01b-440d-958b-0c3ca2490937', 'volume_size': 1} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-717926110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=955aa90d-a01b-440d-958b-0c3ca2490937,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc63eaed6a24acab564f97979a8ebc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:04Z,use_quota=True,user_id='a907e7a68dbf4ab386709caf2431ebda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Creating volume 955aa90d-a01b-440d-958b-0c3ca2490937 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:44:04 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:44:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:04 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 1073741824 Jun 23 12:44:04 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:05 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 1073741824" returned: 0 in 0.969s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:05 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 Jun 23 12:44:05 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:06 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937" returned: 0 in 0.746s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:44:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07625771-84c2-4700-b690-999ddad047cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-955aa90d-a01b-440d-958b-0c3ca2490937', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f32d69-438c-4a31-b784-62262cb7dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:06 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Volume volume-955aa90d-a01b-440d-958b-0c3ca2490937 (955aa90d-a01b-440d-958b-0c3ca2490937): created successfully Jun 23 12:44:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f32d69-438c-4a31-b784-62262cb7dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Flow 'volume_create_manager' (0b12294e-79e6-476a-b3fa-3d642da92c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:06 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e2bbc42a-152e-4954-aff8-2e7d04c8c6e6 tempest-VolumesTransfersV357Test-1718054255 None] Created volume successfully. Jun 23 12:44:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-64426720-8543-4802-bcf5-a57cb4b7eb7d tempest-VolumesTransfersV357Test-532088098 None] Transfer volume completed successfully. Jun 23 12:44:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Acquiring lock "cinder-955aa90d-a01b-440d-958b-0c3ca2490937-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-955aa90d-a01b-440d-958b-0c3ca2490937-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Acquiring lock "cinder-quobyte-955aa90d-a01b-440d-958b-0c3ca2490937" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-quobyte-955aa90d-a01b-440d-958b-0c3ca2490937" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:08 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9f2ad2-54a1-4d05-98e9-d64a0cb48785]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:08 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 Jun 23 12:44:08 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:09 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937" returned: 0 in 0.881s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:09 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937 Jun 23 12:44:09 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:10 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-955aa90d-a01b-440d-958b-0c3ca2490937" returned: 0 in 0.771s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-quobyte-955aa90d-a01b-440d-958b-0c3ca2490937" released by "delete_volume" :: held 1.703s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Created reservations ['0fd325a5-23a7-4d1e-b3a2-43999bd82e0f', '037515b2-23e5-4587-b675-9bb7a75e6daa', '68dd0e62-87ad-4988-a80a-e3524400f68b', '2f605ba8-fada-4b34-b31c-29881eaafa52'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:10 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:44:10 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:11 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.777s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:44:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Deleted volume successfully. Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1cb96a66-18d5-4cbe-9de7-b583319d6711 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-955aa90d-a01b-440d-958b-0c3ca2490937-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Flow 'volume_create_manager' (af23b809-0329-4ea6-ba0e-bfedeea9bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269dba30-1439-4c77-a6e2-830c71b6267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (269dba30-1439-4c77-a6e2-830c71b6267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1808150486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29700b8-467c-49cc-a5e1-555dd14a3984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc63eaed6a24acab564f97979a8ebc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:11Z,use_quota=True,user_id='a907e7a68dbf4ab386709caf2431ebda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed6e237-0a46-4c43-8b98-7fdad61099f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aed6e237-0a46-4c43-8b98-7fdad61099f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b02bebc-b02a-43c1-bd1a-0e17880350ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b02bebc-b02a-43c1-bd1a-0e17880350ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29700b8-467c-49cc-a5e1-555dd14a3984', 'volume_name': 'volume-f29700b8-467c-49cc-a5e1-555dd14a3984', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345e24fb-5ce7-4cf3-802a-fde16a9b0716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (345e24fb-5ce7-4cf3-802a-fde16a9b0716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fd8793-85d7-4d29-98da-357a5fdebb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Volume f29700b8-467c-49cc-a5e1-555dd14a3984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29700b8-467c-49cc-a5e1-555dd14a3984', 'volume_size': 1} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1808150486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29700b8-467c-49cc-a5e1-555dd14a3984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edc63eaed6a24acab564f97979a8ebc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:11Z,use_quota=True,user_id='a907e7a68dbf4ab386709caf2431ebda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Creating volume f29700b8-467c-49cc-a5e1-555dd14a3984 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:44:11 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:44:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:11 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 1073741824 Jun 23 12:44:11 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:12 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 1073741824" returned: 0 in 0.985s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:12 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 Jun 23 12:44:12 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:13 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984" returned: 0 in 0.828s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:44:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49fd8793-85d7-4d29-98da-357a5fdebb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29700b8-467c-49cc-a5e1-555dd14a3984', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e593ca1d-50c0-44c7-b5f9-a7b04f1fad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:13 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Volume volume-f29700b8-467c-49cc-a5e1-555dd14a3984 (f29700b8-467c-49cc-a5e1-555dd14a3984): created successfully Jun 23 12:44:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e593ca1d-50c0-44c7-b5f9-a7b04f1fad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Flow 'volume_create_manager' (af23b809-0329-4ea6-ba0e-bfedeea9bb28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:13 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a61bc11f-f45a-4836-a679-703dc8121447 tempest-VolumesTransfersV357Test-1718054255 None] Created volume successfully. Jun 23 12:44:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Acquiring lock "cinder-f29700b8-467c-49cc-a5e1-555dd14a3984-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-f29700b8-467c-49cc-a5e1-555dd14a3984-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Acquiring lock "cinder-quobyte-f29700b8-467c-49cc-a5e1-555dd14a3984" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-quobyte-f29700b8-467c-49cc-a5e1-555dd14a3984" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:15 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f433e42-dd60-42ab-8ecd-e3a1897f27c3]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:15 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 Jun 23 12:44:15 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:16 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984" returned: 0 in 0.996s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:16 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984 Jun 23 12:44:16 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:17 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f29700b8-467c-49cc-a5e1-555dd14a3984" returned: 0 in 0.907s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-quobyte-f29700b8-467c-49cc-a5e1-555dd14a3984" released by "delete_volume" :: held 1.963s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Created reservations ['217dd174-f397-4185-8ec4-1d07488745f4', '662a0513-847e-4fbe-b703-5030970c9fb8', '436f393f-076a-44cc-9c8b-37b809b173d2', 'ff7b7dd8-664d-4ce2-bc41-32349193d0c4'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:17 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:44:17 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:18 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.892s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:18 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:44:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Deleted volume successfully. Jun 23 12:44:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-062a3d0b-db2f-4ab3-ac60-7638651adac7 tempest-VolumesTransfersV357Test-2021657513 None] Lock "cinder-f29700b8-467c-49cc-a5e1-555dd14a3984-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Acquiring lock "cinder-2cb4401c-85ad-44f6-b6c0-f5f724132853-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "cinder-2cb4401c-85ad-44f6-b6c0-f5f724132853-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Acquiring lock "cinder-quobyte-2cb4401c-85ad-44f6-b6c0-f5f724132853" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "cinder-quobyte-2cb4401c-85ad-44f6-b6c0-f5f724132853" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd77136-c9b2-4096-bdf9-1f7ca4e604a9]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:21 devstack sudo[99435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 Jun 23 12:44:21 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:22 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853" returned: 0 in 0.898s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:22 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853 Jun 23 12:44:22 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:22 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:44:22 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:22 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2cb4401c-85ad-44f6-b6c0-f5f724132853" returned: 0 in 0.893s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:22 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "cinder-quobyte-2cb4401c-85ad-44f6-b6c0-f5f724132853" released by "delete_volume" :: held 1.843s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:23 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.823s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Created reservations ['7fa5c5e7-4ed6-43b9-a462-6c4e0e13e756', '19b37b8f-9c27-4a25-a775-5367d404fe17', '651ecb77-783e-4153-b7cf-57a8c3f863b4', '6441ecc4-4771-4d69-9303-da061cac7d7d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:23 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:44:23 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:24 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.846s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:24 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:44:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Deleted volume successfully. Jun 23 12:44:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1701570e-18c6-4c5c-ad82-d65fd65402eb tempest-AttachVolumeShelveTestJSON-1804914398 None] Lock "cinder-2cb4401c-85ad-44f6-b6c0-f5f724132853-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Flow 'volume_create_manager' (2d074017-0d8a-4dbc-a40d-c38ca758e79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7016bb-1f26-48f1-b462-571b4fd64cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7016bb-1f26-48f1-b462-571b4fd64cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1374304503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe7bc0b-27df-4c0b-a18b-3be5ebebc835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b2a18311a043b68288f3b6cc242d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:26Z,use_quota=True,user_id='3c22ebb25a7e41eebfdc8c56e3b844dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2911c4-0356-4df4-a1d8-767214f133e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2911c4-0356-4df4-a1d8-767214f133e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3318b051-b384-46fe-a01a-e4b8250a3f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:25 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3318b051-b384-46fe-a01a-e4b8250a3f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cfe7bc0b-27df-4c0b-a18b-3be5ebebc835', 'volume_name': 'volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fb680c-f877-4ff6-aedf-b9b8c5482d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fb680c-f877-4ff6-aedf-b9b8c5482d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c5c902-4fd0-4af2-a3c2-53833c938e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Volume cfe7bc0b-27df-4c0b-a18b-3be5ebebc835: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Trying to clone cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 12:44:26 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Image download 20.69 MB at 20.69 MB/s Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9053067-c1b3-4ced-a48b-8b35c6f9db46]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:26 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD Jun 23 12:44:26 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:27 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:27 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd is fetched for user 3c22ebb25a7e41eebfdc8c56e3b844dc. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 12:44:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1655abe6-dc9f-4331-8106-c34f15ce37e4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:27 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD Jun 23 12:44:27 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:28 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1374304503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfe7bc0b-27df-4c0b-a18b-3be5ebebc835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b2a18311a043b68288f3b6cc242d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:26Z,use_quota=True,user_id='3c22ebb25a7e41eebfdc8c56e3b844dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Creating volume cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:44:28 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:44:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:28 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 1073741824 Jun 23 12:44:28 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:29 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 1073741824" returned: 0 in 1.177s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:29 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:29 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:30 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 0 in 1.043s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:44:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:30 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Attempting download of 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume cfe7bc0b-27df-4c0b-a18b-3be5ebebc835. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 12:44:30 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b87f25-56f7-4495-b120-aad9127bec28]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_dzk6p3c9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:30 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_dzk6p3c9 Jun 23 12:44:30 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:31 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_dzk6p3c9" returned: 0 in 1.132s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_dzk6p3c9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:32 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_dzk6p3c9 Jun 23 12:44:32 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:32 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_dzk6p3c9" returned: 1 in 0.978s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_dzk6p3c9' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:44:32 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa2808-1344-4ce7-9d70-df97380789ed]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:33 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD Jun 23 12:44:33 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:33 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:33 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd was qcow2, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 12:44:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:33 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:33 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:36 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 0 in 2.748s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:36 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_7r3ybzjldevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:44:36 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Converted 112.00 MB image at 40.73 MB/s Jun 23 12:44:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:36 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 1G Jun 23 12:44:36 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:37 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 1G" returned: 0 in 0.790s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:37 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ea82db-c824-48ab-ad16-e7010045f651]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:37 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:37 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:38 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 0 in 0.936s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:38 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:38 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 1 in 0.848s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Downloaded image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 12:44:39 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd for user 3c22ebb25a7e41eebfdc8c56e3b844dc is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Marking volume cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Copying metadata from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd to cfe7bc0b-27df-4c0b-a18b-3be5ebebc835. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Creating volume glance metadata for volume cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 backed by image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03c5c902-4fd0-4af2-a3c2-53833c938e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8afe469-19a9-4cd2-9bd0-80233adddd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:39 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Volume volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 (cfe7bc0b-27df-4c0b-a18b-3be5ebebc835): created successfully Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8afe469-19a9-4cd2-9bd0-80233adddd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Flow 'volume_create_manager' (2d074017-0d8a-4dbc-a40d-c38ca758e79a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d85f61cd-0c44-4f0c-9196-9e723551718b tempest-VolumesExtendTest-283200636 None] Created volume successfully. Jun 23 12:44:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:40 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3543c7-1380-4a7c-a8fb-9e5cf07d4c2b]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:40 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:40 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:41 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 0 in 1.574s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:42 devstack sudo[99738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:42 devstack sudo[99738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:43 devstack sudo[99738]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 1 in 1.458s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:44:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 2G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 2G" returned: 0 in 0.211s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.348s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:43 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c2975eac-290d-4d33-bf67-54a94f87796c tempest-VolumesExtendTest-283200636 None] Extend volume completed successfully. Jun 23 12:44:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Acquiring lock "cinder-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Lock "cinder-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Acquiring lock "cinder-quobyte-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:44:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" acquired by "delete_volume" :: waited 0.043s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:44:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-46def4fc-601d-4f09-a7fa-4ef8e1b29e8b req-ce99fce6-3476-4cba-b7d0-0c6f1c903f5f tempest-AttachVolumeNegativeTest-1678089407 None] Terminate volume connection completed successfully. Jun 23 12:44:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-46def4fc-601d-4f09-a7fa-4ef8e1b29e8b req-ce99fce6-3476-4cba-b7d0-0c6f1c903f5f tempest-AttachVolumeNegativeTest-1678089407 None] Deleting attachment ac05f833-97f4-4ad9-b192-df4459c39c3a. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:44:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[de974c2a-8102-4c4a-b29c-56ac6023b64f]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:46 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:46 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:47 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 0 in 1.775s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:47 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:47 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:48 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 1 in 0.940s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:44:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:48 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835 Jun 23 12:44:48 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:49 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" returned: 0 in 1.133s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835" released by "delete_volume" :: held 4.042s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:49 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=45,cinder:INSERT=21,cinder:UPDATE=56,cinder:DELETE=6 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:44:49 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Created reservations ['6c315dff-17e6-435f-94a7-4ec403e986c5', '1bece444-1be0-49e1-b00d-8ef4a36a8c33', '9eee586c-6bdd-45b3-9eeb-6f0493eae04f', '1361d781-42ee-48c3-9ff0-a4773c005967'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:44:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:50 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:44:50 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Flow 'volume_create_manager' (f0ebcd53-72d4-4037-8c5f-a1109e76ea87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73973907-061b-4437-ae5c-2f04f9d5d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73973907-061b-4437-ae5c-2f04f9d5d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1683584278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f431b6-2a47-4b84-baf9-e2c6b1bc742f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b2a18311a043b68288f3b6cc242d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:51Z,use_quota=True,user_id='3c22ebb25a7e41eebfdc8c56e3b844dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3599be7b-d008-463e-b558-7f0213944099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3599be7b-d008-463e-b558-7f0213944099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4886726-17b8-44b2-8766-c06febd24ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4886726-17b8-44b2-8766-c06febd24ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f431b6-2a47-4b84-baf9-e2c6b1bc742f', 'volume_name': 'volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead767c9-29e6-4cad-b7c7-ad3efb3b0f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead767c9-29e6-4cad-b7c7-ad3efb3b0f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ffaf6e-79eb-4288-b42a-e2e183c41066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:51 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Volume 89f431b6-2a47-4b84-baf9-e2c6b1bc742f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f', 'volume_size': 1} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1683584278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f431b6-2a47-4b84-baf9-e2c6b1bc742f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b2a18311a043b68288f3b6cc242d57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:44:51Z,use_quota=True,user_id='3c22ebb25a7e41eebfdc8c56e3b844dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Creating volume 89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:44:51 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:51 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f 1073741824 Jun 23 12:44:51 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:51 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.251s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:44:51 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Deleted volume successfully. Jun 23 12:44:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d11e52c1-3d50-4323-bd5b-0e2bbc2e131c tempest-VolumesExtendTest-283200636 None] Lock "cinder-cfe7bc0b-27df-4c0b-a18b-3be5ebebc835-delete_volume" released by "delete_volume" :: held 5.817s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:44:52 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f 1073741824" returned: 0 in 1.363s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:52 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=62,cinder:SELECT=52,cinder:INSERT=19,cinder:DELETE=3 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:44:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:52 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f Jun 23 12:44:52 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:53 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" returned: 0 in 0.788s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] <== create_volume: return (2237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:44:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.244s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:44:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ffaf6e-79eb-4288-b42a-e2e183c41066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bedbed-fd96-4299-9887-f4fdd8341fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:44:53 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Volume volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f (89f431b6-2a47-4b84-baf9-e2c6b1bc742f): created successfully Jun 23 12:44:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bedbed-fd96-4299-9887-f4fdd8341fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:44:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Flow 'volume_create_manager' (f0ebcd53-72d4-4037-8c5f-a1109e76ea87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:44:53 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-696060d9-f143-427b-a2e9-82eff5d6b87d tempest-VolumesExtendTest-283200636 None] Created volume successfully. Jun 23 12:44:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:44:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:44:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Creating offline snapshot 4327c364-0868-4a4b-9e32-dfc30b968b48 of volume 89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:44:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[10775a95-4278-4e40-abf8-6f8a496fd6fa]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:44:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:54 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f Jun 23 12:44:54 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:56 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" returned: 0 in 1.583s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:56 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 1G Jun 23 12:44:56 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:57 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 1G" returned: 0 in 1.030s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:57 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 Jun 23 12:44:57 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48" returned: 0 in 1.139s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:58 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 is being set with open permissions: ugo+rw Jun 23 12:44:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:58 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:58 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 Jun 23 12:44:58 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:44:59 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jun 23 12:44:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48" returned: 0 in 1.253s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:44:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:44:59 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.info Jun 23 12:44:59 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:00 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.info" returned: 0 in 1.233s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:00 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.info is being set with open permissions: ugo+rw Jun 23 12:45:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:00 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.info Jun 23 12:45:00 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:02 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.info" returned: 0 in 1.073s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.467s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-89de888d-3e8f-40cd-9f3d-963c1e0209cc tempest-VolumesExtendTest-283200636 None] Create snapshot completed successfully Jun 23 12:45:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:02 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfe98d1-2966-4ca8-a9dd-adeafc91dcf4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:02 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f Jun 23 12:45:02 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:03 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" returned: 0 in 1.200s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 2G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 2G" returned: 0 in 0.185s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.461s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9046bf1f-1fec-4843-ab46-eea1c2c9c4f1 tempest-VolumesExtendTest-283200636 None] Extend volume completed successfully. Jun 23 12:45:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Acquiring lock "cinder-4327c364-0868-4a4b-9e32-dfc30b968b48-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Lock "cinder-4327c364-0868-4a4b-9e32-dfc30b968b48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Acquiring lock "cinder-quobyte-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Acquiring lock "cinder-quobyte-4327c364-0868-4a4b-9e32-dfc30b968b48" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-4327c364-0868-4a4b-9e32-dfc30b968b48" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Deleting offline snapshot 4327c364-0868-4a4b-9e32-dfc30b968b48 of volume 89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:45:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] snapshot_file for this snap is: volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:45:05 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1cc26b-ffbd-467c-9339-1a926a29b870]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:05 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 Jun 23 12:45:05 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:06 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48" returned: 0 in 1.131s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:45:06 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c962f6-55f7-4863-8dda-69309c46609f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:06 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f Jun 23 12:45:06 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:07 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" returned: 0 in 0.891s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:07 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 Jun 23 12:45:07 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:08 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48" returned: 0 in 1.213s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:08 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48 Jun 23 12:45:08 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:09 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f.4327c364-0868-4a4b-9e32-dfc30b968b48" returned: 0 in 1.233s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-4327c364-0868-4a4b-9e32-dfc30b968b48" released by "_delete_snapshot" :: held 4.639s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" released by "delete_snapshot" :: held 4.675s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:09 devstack cinder-volume[93659]: WARNING cinder.quota [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:45:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Created reservations ['c441dd7b-fd18-48ba-92bb-b67db463f8a6', '85023ad5-941f-43e3-a0e2-43cb9330596f', '870830f1-06e2-4830-a4f8-ec3cd8a5c6ef', '6441fe7a-0f42-4e34-b45d-51a824ccaae4'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:45:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Delete snapshot completed successfully. Jun 23 12:45:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5f5f5c3-7a5b-4093-97dd-7c4e6f022dfc tempest-VolumesExtendTest-283200636 None] Lock "cinder-4327c364-0868-4a4b-9e32-dfc30b968b48-delete_snapshot" released by "delete_snapshot" :: held 4.876s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Acquiring lock "cinder-89f431b6-2a47-4b84-baf9-e2c6b1bc742f-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Lock "cinder-89f431b6-2a47-4b84-baf9-e2c6b1bc742f-delete_volume" acquired by "delete_volume" :: waited 0.148s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Acquiring lock "cinder-quobyte-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:11 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b86f1a1-5d91-440b-975c-b8111490770f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:11 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f Jun 23 12:45:11 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:13 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" returned: 0 in 2.024s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:13 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f Jun 23 12:45:13 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:14 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" returned: 0 in 1.720s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Lock "cinder-quobyte-89f431b6-2a47-4b84-baf9-e2c6b1bc742f" released by "delete_volume" :: held 3.972s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:15 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Created reservations ['b34a378f-b882-465b-877e-a70fb1e6f5a2', '1ddaf388-6a51-41e1-8951-b16881074e2e', '42b3aa6d-2226-4a6b-8c36-b134d13fa6b7', '96a53c8f-e699-4bbf-baad-7d29cf5ec4a3'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:45:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:45:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:45:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:15 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:45:15 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:17 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.888s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:17 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:45:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Deleted volume successfully. Jun 23 12:45:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37bea95e-375d-43e9-916a-54f64da01bcb tempest-VolumesExtendTest-283200636 None] Lock "cinder-89f431b6-2a47-4b84-baf9-e2c6b1bc742f-delete_volume" released by "delete_volume" :: held 6.523s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:19 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Flow 'volume_create_manager' (c8067653-6546-482c-88c7-4c44187061b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcffcc7-bee9-429f-857e-179c7da57ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcffcc7-bee9-429f-857e-179c7da57ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1516442555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8d7514-96e2-4c39-b8f4-ddd8f171f653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988af3d74f564336b7bd162fc4288659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:20Z,use_quota=True,user_id='97a4df022109430a889cf15d6038d7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29991928-348d-425a-91db-400a38c7be8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29991928-348d-425a-91db-400a38c7be8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d709025-57f4-42f0-b102-2239c37c4563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d709025-57f4-42f0-b102-2239c37c4563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba8d7514-96e2-4c39-b8f4-ddd8f171f653', 'volume_name': 'volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4253b3d-55bb-4e4c-a193-8cfe88b31143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4253b3d-55bb-4e4c-a193-8cfe88b31143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb6f9c3-2bba-4298-acfe-7de09a74f49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:20 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Volume ba8d7514-96e2-4c39-b8f4-ddd8f171f653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653', 'volume_size': 1} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1516442555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba8d7514-96e2-4c39-b8f4-ddd8f171f653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='988af3d74f564336b7bd162fc4288659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:20Z,use_quota=True,user_id='97a4df022109430a889cf15d6038d7c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Creating volume ba8d7514-96e2-4c39-b8f4-ddd8f171f653 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:45:20 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:45:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:20 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 1073741824 Jun 23 12:45:20 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Flow 'volume_create_manager' (18870d1e-615a-433c-80d9-f93e889a78f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24244723-5063-409d-80a6-59cb3ee526bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24244723-5063-409d-80a6-59cb3ee526bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-448995767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e435945-d9f8-4004-b4a7-ee68a8792ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4d79e687fc4260af8b0dde76405e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:21Z,use_quota=True,user_id='6547f023e3004d86ae601e2b83b85923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f8037c-016e-4ffe-8348-2e5cf5227d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f8037c-016e-4ffe-8348-2e5cf5227d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c820cfbc-2b9e-4792-86a2-a455b7c87a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c820cfbc-2b9e-4792-86a2-a455b7c87a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e435945-d9f8-4004-b4a7-ee68a8792ee1', 'volume_name': 'volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960f916-7ed0-49f7-94da-c730fe37381e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6960f916-7ed0-49f7-94da-c730fe37381e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7b622c-3b42-44aa-9a39-03f9df2ba962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:21 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1', 'volume_size': 1} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:21 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 1073741824" returned: 0 in 1.720s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:21 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 Jun 23 12:45:21 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:22 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:45:22 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:22 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653" returned: 0 in 0.882s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] <== create_volume: return (2643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.646s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-448995767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e435945-d9f8-4004-b4a7-ee68a8792ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f4d79e687fc4260af8b0dde76405e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:21Z,use_quota=True,user_id='6547f023e3004d86ae601e2b83b85923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Creating volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:45:22 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb6f9c3-2bba-4298-acfe-7de09a74f49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d904a4-e4c1-4764-b3e7-7a3bef3153c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:22 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 1073741824 Jun 23 12:45:22 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:22 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Volume volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 (ba8d7514-96e2-4c39-b8f4-ddd8f171f653): created successfully Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d904a4-e4c1-4764-b3e7-7a3bef3153c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Flow 'volume_create_manager' (c8067653-6546-482c-88c7-4c44187061b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:22 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-13b28c51-4755-4667-9f5f-3712e1009493 tempest-ServerRescueNegativeTestJSON-36985751 None] Created volume successfully. Jun 23 12:45:23 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.563s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:45:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:45:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:45:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:45:25 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 1073741824" returned: 0 in 2.323s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:25 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 Jun 23 12:45:25 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:27 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1" returned: 0 in 2.233s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] <== create_volume: return (4655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:45:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.662s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e7b622c-3b42-44aa-9a39-03f9df2ba962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09539d9e-be4c-46ed-9eff-3275589e57d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Volume volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 (3e435945-d9f8-4004-b4a7-ee68a8792ee1): created successfully Jun 23 12:45:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09539d9e-be4c-46ed-9eff-3275589e57d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Flow 'volume_create_manager' (18870d1e-615a-433c-80d9-f93e889a78f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9afe18bb-6018-42fd-83a2-f031ef53f752 tempest-VolumesSnapshotListTestJSON-46549714 None] Created volume successfully. Jun 23 12:45:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Creating offline snapshot 03146799-2b48-417a-83c0-48f97e5a6718 of volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:45:28 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[901d3a8d-3cf5-40af-824d-788743a26d5d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:28 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 Jun 23 12:45:28 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:30 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1" returned: 0 in 1.455s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:30 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 1G Jun 23 12:45:30 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:31 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 1G" returned: 0 in 1.504s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:31 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 Jun 23 12:45:31 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:32 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718" returned: 0 in 0.889s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:32 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 is being set with open permissions: ugo+rw Jun 23 12:45:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:32 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 Jun 23 12:45:32 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:33 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718" returned: 0 in 0.889s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:33 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.info Jun 23 12:45:33 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:34 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.info" returned: 0 in 0.696s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:34 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.info is being set with open permissions: ugo+rw Jun 23 12:45:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:34 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.info Jun 23 12:45:34 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:35 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.info" returned: 0 in 0.742s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.323s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a70741f8-294c-43d8-9b2a-fbeba7cc0230 tempest-VolumesSnapshotListTestJSON-46549714 None] Create snapshot completed successfully Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Flow 'volume_create_manager' (ea948599-eea8-4bd9-81ee-b386a601de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7368dd-2252-41e3-80c5-5a319fcc80dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb7368dd-2252-41e3-80c5-5a319fcc80dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-134662621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202fd4b2-b619-4d9a-83c3-e383549db45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707d55d30f845c3ae0740142e1d61b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:36Z,use_quota=True,user_id='666c8cd9c2b640f9a72487067743b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f074bd8e-b562-4917-85e2-405f2feef02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f074bd8e-b562-4917-85e2-405f2feef02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1c7e22-f5ac-417f-991f-250d5364c818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a1c7e22-f5ac-417f-991f-250d5364c818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202fd4b2-b619-4d9a-83c3-e383549db45f', 'volume_name': 'volume-202fd4b2-b619-4d9a-83c3-e383549db45f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa328544-a2e7-4467-a957-6c64f9082f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa328544-a2e7-4467-a957-6c64f9082f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbaaff7-fb2f-4937-9302-d3b9def95f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:36 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Volume 202fd4b2-b619-4d9a-83c3-e383549db45f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202fd4b2-b619-4d9a-83c3-e383549db45f', 'volume_size': 1} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-134662621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202fd4b2-b619-4d9a-83c3-e383549db45f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707d55d30f845c3ae0740142e1d61b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:36Z,use_quota=True,user_id='666c8cd9c2b640f9a72487067743b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Creating volume 202fd4b2-b619-4d9a-83c3-e383549db45f {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:45:36 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:36 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f 1073741824 Jun 23 12:45:36 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:37 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f 1073741824" returned: 0 in 1.483s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:38 devstack sudo[100657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f Jun 23 12:45:38 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:39 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f" returned: 0 in 1.106s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] <== create_volume: return (2684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.686s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.576s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Creating offline snapshot 89a62a6a-07aa-40bd-abe0-ddb78364c2b2 of volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbaaff7-fb2f-4937-9302-d3b9def95f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202fd4b2-b619-4d9a-83c3-e383549db45f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5217e-a874-499e-bf42-d80b5716f314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c707dc89-40e5-41e2-88c9-d4656934ebf4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:39 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Volume volume-202fd4b2-b619-4d9a-83c3-e383549db45f (202fd4b2-b619-4d9a-83c3-e383549db45f): created successfully Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba5217e-a874-499e-bf42-d80b5716f314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Flow 'volume_create_manager' (ea948599-eea8-4bd9-81ee-b386a601de57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-623a3ec3-d7fa-4ca7-a2cb-2f37b6214f91 tempest-AttachVolumeTestJSON-430848257 None] Created volume successfully. Jun 23 12:45:39 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 Jun 23 12:45:39 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:40 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718" returned: 0 in 1.084s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:45:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:40 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 1G Jun 23 12:45:40 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:41 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 1G" returned: 0 in 1.206s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:41 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 Jun 23 12:45:41 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:42 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2" returned: 0 in 0.746s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:42 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 is being set with open permissions: ugo+rw Jun 23 12:45:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:42 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 Jun 23 12:45:42 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:43 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2" returned: 0 in 1.053s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.257s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:43 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9514cdec-59b1-47b8-8d08-f2672fde6f7f tempest-VolumesSnapshotListTestJSON-46549714 None] Create snapshot completed successfully Jun 23 12:45:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-2eb17889-b1a8-4213-9713-ca695d395c16 req-4e9b82b3-3194-4185-8b50-bd2c86d26e9e tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-2eb17889-b1a8-4213-9713-ca695d395c16 req-4e9b82b3-3194-4185-8b50-bd2c86d26e9e tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:44 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e3d44-cb13-48b4-85a3-c4aa75c87b98]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-2eb17889-b1a8-4213-9713-ca695d395c16 req-4e9b82b3-3194-4185-8b50-bd2c86d26e9e tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:44 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f Jun 23 12:45:44 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:45 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-2eb17889-b1a8-4213-9713-ca695d395c16 req-4e9b82b3-3194-4185-8b50-bd2c86d26e9e tempest-AttachVolumeTestJSON-430848257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f" returned: 0 in 1.238s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-2eb17889-b1a8-4213-9713-ca695d395c16 req-4e9b82b3-3194-4185-8b50-bd2c86d26e9e tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.266s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.831s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Creating offline snapshot 0f20ca9c-1561-4b76-a4c2-82d674dc6a6f of volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:45:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca220b7-d036-474e-a05b-3cdb7ec45eca]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-2eb17889-b1a8-4213-9713-ca695d395c16 req-4e9b82b3-3194-4185-8b50-bd2c86d26e9e tempest-AttachVolumeTestJSON-430848257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-202fd4b2-b619-4d9a-83c3-e383549db45f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9851da91-c0ab-46b8-8902-7efbd1fb9d51', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:45:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-2eb17889-b1a8-4213-9713-ca695d395c16 req-4e9b82b3-3194-4185-8b50-bd2c86d26e9e tempest-AttachVolumeTestJSON-430848257 None] attachment_update completed successfully. Jun 23 12:45:45 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 Jun 23 12:45:45 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:46 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2" returned: 0 in 0.998s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:45:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:46 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f 1G Jun 23 12:45:46 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Acquiring lock "cinder-ba8d7514-96e2-4c39-b8f4-ddd8f171f653-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "cinder-ba8d7514-96e2-4c39-b8f4-ddd8f171f653-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Acquiring lock "cinder-quobyte-ba8d7514-96e2-4c39-b8f4-ddd8f171f653" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "cinder-quobyte-ba8d7514-96e2-4c39-b8f4-ddd8f171f653" acquired by "delete_volume" :: waited 0.028s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:47 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[982a9511-c9fc-4b20-a15a-607225cc270a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:47 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 Jun 23 12:45:47 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:47 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f 1G" returned: 0 in 1.553s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:47 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f Jun 23 12:45:47 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:48 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653" returned: 0 in 1.162s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:48 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653 Jun 23 12:45:48 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:48 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" returned: 0 in 0.973s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:48 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f is being set with open permissions: ugo+rw Jun 23 12:45:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:48 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f Jun 23 12:45:48 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:48 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba8d7514-96e2-4c39-b8f4-ddd8f171f653" returned: 0 in 0.732s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "cinder-quobyte-ba8d7514-96e2-4c39-b8f4-ddd8f171f653" released by "delete_volume" :: held 1.975s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:49 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Created reservations ['250a39ad-3ef1-463b-ab27-e8c01ed50ab1', '8972de08-ffaa-4720-82e4-4e5b3bb104fa', 'a5091ce3-f5da-4c76-ab1d-01000973bb9a', 'd4de2ec4-bd2a-40c4-b1b0-46c1bdfb37a1'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:45:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:45:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:45:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:49 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:45:49 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:50 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" returned: 0 in 1.189s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:50 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=47,cinder:INSERT=12,cinder:UPDATE=49,cinder:DELETE=5 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:45:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.911s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-68916f89-5de1-4368-b26b-84bc33da78cb tempest-VolumesSnapshotListTestJSON-46549714 None] Create snapshot completed successfully Jun 23 12:45:50 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.256s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:50 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:45:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Deleted volume successfully. Jun 23 12:45:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d6172756-c925-463f-9cf4-1af5d9794c0f tempest-ServerRescueNegativeTestJSON-36985751 None] Lock "cinder-ba8d7514-96e2-4c39-b8f4-ddd8f171f653-delete_volume" released by "delete_volume" :: held 3.667s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-0f20ca9c-1561-4b76-a4c2-82d674dc6a6f-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-0f20ca9c-1561-4b76-a4c2-82d674dc6a6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-quobyte-0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Deleting offline snapshot 0f20ca9c-1561-4b76-a4c2-82d674dc6a6f of volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] snapshot_file for this snap is: volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=44,cinder:DELETE=5,cinder:SELECT=38,cinder:INSERT=7 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff686e2-dd40-401d-b8eb-afcdd49b8b27]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Flow 'volume_create_manager' (35c3cf05-1cc5-4f9b-ab05-5571d46b1633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fc03b1-9d5e-471b-a401-e9d49c88824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fc03b1-9d5e-471b-a401-e9d49c88824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1972639068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa44317-2048-4754-a6a5-2e8bed3aa3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7338e3c17e044fc937d44421d783283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:53Z,use_quota=True,user_id='7f2f037980874b7c929ed13e0d85714b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe2703c-a51c-47ce-918d-f5e7390483a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbe2703c-a51c-47ce-918d-f5e7390483a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e142c1c0-af4f-4402-be33-7b8853a77ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e142c1c0-af4f-4402-be33-7b8853a77ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa44317-2048-4754-a6a5-2e8bed3aa3f6', 'volume_name': 'volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a784b7c3-77f9-47c9-9085-9e830aaa3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a784b7c3-77f9-47c9-9085-9e830aaa3aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e51cba-4dce-414b-9532-27532caff675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:53 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Volume dfa44317-2048-4754-a6a5-2e8bed3aa3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6', 'volume_size': 1} Jun 23 12:45:53 devstack sudo[101273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f Jun 23 12:45:53 devstack sudo[101273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1972639068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa44317-2048-4754-a6a5-2e8bed3aa3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7338e3c17e044fc937d44421d783283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:45:53Z,use_quota=True,user_id='7f2f037980874b7c929ed13e0d85714b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Creating volume dfa44317-2048-4754-a6a5-2e8bed3aa3f6 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:45:53 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:45:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:53 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 1073741824 Jun 23 12:45:53 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:54 devstack sudo[101273]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" returned: 0 in 1.596s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:45:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b92583-cb96-4a4c-8359-a421aa3ff69a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:54 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 Jun 23 12:45:54 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:55 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 1073741824" returned: 0 in 2.173s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:55 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 Jun 23 12:45:55 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:55 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2" returned: 0 in 1.245s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:45:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:55 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f Jun 23 12:45:55 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:56 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6" returned: 0 in 1.207s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] <== create_volume: return (3473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.477s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e51cba-4dce-414b-9532-27532caff675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13f677b-9cbc-49c3-b68b-24d81f9fe231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:45:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Volume volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 (dfa44317-2048-4754-a6a5-2e8bed3aa3f6): created successfully Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13f677b-9cbc-49c3-b68b-24d81f9fe231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Flow 'volume_create_manager' (35c3cf05-1cc5-4f9b-ab05-5571d46b1633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:45:56 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-628ec852-597a-4ec5-bfa3-0d615fb17582 tempest-AttachVolumeNegativeTest-1678089407 None] Created volume successfully. Jun 23 12:45:56 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" returned: 0 in 1.190s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:56 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f Jun 23 12:45:56 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:57 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" returned: 0 in 0.904s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-0f20ca9c-1561-4b76-a4c2-82d674dc6a6f" released by "_delete_snapshot" :: held 5.111s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" released by "delete_snapshot" :: held 5.141s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Created reservations ['4a6ee748-3179-4a9f-a882-be5139734833', '01c9f472-7300-4c7d-8a09-4dd047eb7b90', '6c2289b7-3510-4b8d-82ae-cd0799335992', '7fcdf9d3-dc56-4a8c-b7dc-8818421a2fee'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:45:58 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Delete snapshot completed successfully. Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0e1a50a-f599-48f9-9d7b-6717c135b706 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-0f20ca9c-1561-4b76-a4c2-82d674dc6a6f-delete_snapshot" released by "delete_snapshot" :: held 5.323s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-89a62a6a-07aa-40bd-abe0-ddb78364c2b2-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-89a62a6a-07aa-40bd-abe0-ddb78364c2b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-quobyte-89a62a6a-07aa-40bd-abe0-ddb78364c2b2" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-89a62a6a-07aa-40bd-abe0-ddb78364c2b2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Deleting offline snapshot 89a62a6a-07aa-40bd-abe0-ddb78364c2b2 of volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] snapshot_file for this snap is: volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22c6281-3df8-4466-9d47-430c7ba45388]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:58 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 Jun 23 12:45:58 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:45:59 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Jun 23 12:45:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2" returned: 0 in 1.129s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:45:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:45:59 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[71196f0d-7d74-44b0-910e-51d3ed377369]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:45:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:45:59 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 Jun 23 12:45:59 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:00 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718" returned: 0 in 1.126s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:46:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:00 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 Jun 23 12:46:00 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-c393ead4-f40b-4b28-bf8e-d9fcf177bf38 req-c06901fa-fd23-4117-90b2-10a1789b376e tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-c393ead4-f40b-4b28-bf8e-d9fcf177bf38 req-c06901fa-fd23-4117-90b2-10a1789b376e tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:00 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec17cb1-ac55-4557-b0a0-d92f62a14807]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-c393ead4-f40b-4b28-bf8e-d9fcf177bf38 req-c06901fa-fd23-4117-90b2-10a1789b376e tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:00 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 Jun 23 12:46:00 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:01 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2" returned: 0 in 0.936s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:01 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2 Jun 23 12:46:01 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:01 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-c393ead4-f40b-4b28-bf8e-d9fcf177bf38 req-c06901fa-fd23-4117-90b2-10a1789b376e tempest-AttachVolumeNegativeTest-1678089407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6" returned: 0 in 1.084s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-c393ead4-f40b-4b28-bf8e-d9fcf177bf38 req-c06901fa-fd23-4117-90b2-10a1789b376e tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.120s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-c393ead4-f40b-4b28-bf8e-d9fcf177bf38 req-c06901fa-fd23-4117-90b2-10a1789b376e tempest-AttachVolumeNegativeTest-1678089407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8f4a75d6-20f0-4c09-b8ac-6ab9c25b647b', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:46:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-c393ead4-f40b-4b28-bf8e-d9fcf177bf38 req-c06901fa-fd23-4117-90b2-10a1789b376e tempest-AttachVolumeNegativeTest-1678089407 None] attachment_update completed successfully. Jun 23 12:46:02 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.89a62a6a-07aa-40bd-abe0-ddb78364c2b2" returned: 0 in 1.021s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-89a62a6a-07aa-40bd-abe0-ddb78364c2b2" released by "_delete_snapshot" :: held 4.352s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" released by "delete_snapshot" :: held 4.388s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:02 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Created reservations ['3f056daf-642c-40a1-8a25-ab391574e951', 'b90b980d-5c4f-42b3-98f4-a7dfbd457664', '379e5447-d632-4343-b38c-e9c9a1dd175a', 'ac22d782-0d59-4ca9-9ebc-d60dbc940574'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:46:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Delete snapshot completed successfully. Jun 23 12:46:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5087ecb6-3bc7-4363-8c37-0679132fa6dd tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-89a62a6a-07aa-40bd-abe0-ddb78364c2b2-delete_snapshot" released by "delete_snapshot" :: held 4.546s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-03146799-2b48-417a-83c0-48f97e5a6718-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-03146799-2b48-417a-83c0-48f97e5a6718-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-quobyte-03146799-2b48-417a-83c0-48f97e5a6718" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-03146799-2b48-417a-83c0-48f97e5a6718" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Deleting offline snapshot 03146799-2b48-417a-83c0-48f97e5a6718 of volume 3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] snapshot_file for this snap is: volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[17917ffb-a80e-4ea4-b73f-44c7ae8c1866]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:03 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 Jun 23 12:46:03 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:04 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718" returned: 0 in 0.879s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:46:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d5a0f0-6b4d-410c-85a3-fb72e68d7f5c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:04 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 Jun 23 12:46:04 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:05 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1" returned: 0 in 0.897s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:05 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 Jun 23 12:46:05 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:06 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718" returned: 0 in 1.075s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:06 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718 Jun 23 12:46:06 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:07 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1.03146799-2b48-417a-83c0-48f97e5a6718" returned: 0 in 1.248s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-03146799-2b48-417a-83c0-48f97e5a6718" released by "_delete_snapshot" :: held 4.253s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" released by "delete_snapshot" :: held 4.292s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:08 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Created reservations ['c88c5e4b-2148-4d36-b8af-4a2e4f38af03', '80136f71-0f05-4c18-be73-c62be8a0005e', 'dda2e199-b380-4e15-b27a-3ee333443b1e', '3ea8de05-031f-4824-acdb-5d142058384d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:46:08 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Delete snapshot completed successfully. Jun 23 12:46:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0d1d2e7-ac73-471e-b2eb-12fd838e78da tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-03146799-2b48-417a-83c0-48f97e5a6718-delete_snapshot" released by "delete_snapshot" :: held 4.509s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-3e435945-d9f8-4004-b4a7-ee68a8792ee1-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-3e435945-d9f8-4004-b4a7-ee68a8792ee1-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:09 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[371c138e-49b7-448b-a0e7-8b1d18d8a076]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:09 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 Jun 23 12:46:09 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:10 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1" returned: 0 in 1.084s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:10 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1 Jun 23 12:46:10 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-0142b08b-735f-4010-9855-8e81a00c2622 req-ec4ddab5-f836-4e1f-8a11-89b501470f01 tempest-AttachVolumeNegativeTest-1678089407 None] Terminate volume connection completed successfully. Jun 23 12:46:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-0142b08b-735f-4010-9855-8e81a00c2622 req-ec4ddab5-f836-4e1f-8a11-89b501470f01 tempest-AttachVolumeNegativeTest-1678089407 None] Deleting attachment 8f4a75d6-20f0-4c09-b8ac-6ab9c25b647b. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:46:11 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e435945-d9f8-4004-b4a7-ee68a8792ee1" returned: 0 in 1.177s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-quobyte-3e435945-d9f8-4004-b4a7-ee68a8792ee1" released by "delete_volume" :: held 2.342s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Created reservations ['43aefdbb-f1fc-4828-baca-355df908893e', 'd8a1a7fe-ad8b-4fe3-91e4-a7748e34fd7b', '44f590cd-33a8-4d33-b40a-9231bb3ab5b8', '68daeffa-c4b7-43df-ad97-3e793a20a40a'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:11 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:46:11 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:12 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.775s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:12 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:46:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Deleted volume successfully. Jun 23 12:46:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7043bd0a-491d-4128-8201-3a4e2e396592 tempest-VolumesSnapshotListTestJSON-46549714 None] Lock "cinder-3e435945-d9f8-4004-b4a7-ee68a8792ee1-delete_volume" released by "delete_volume" :: held 3.447s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Flow 'volume_create_manager' (6a391dc4-16b8-4bb5-bb6d-7a1721ddba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290579c6-ba6f-44c1-bd10-dcb573094507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290579c6-ba6f-44c1-bd10-dcb573094507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-559290680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0299c25-3c29-4ee9-b536-19309d97e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ab70b37bf5473182238c1b70019f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:46:19Z,use_quota=True,user_id='997abd569daa4ff9a5bf14d323c98fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05bdf39-a5f3-40a7-81a3-b4dea3729c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05bdf39-a5f3-40a7-81a3-b4dea3729c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57872e4-e621-4bdd-aa5f-3fa2ff1fce16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b57872e4-e621-4bdd-aa5f-3fa2ff1fce16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0299c25-3c29-4ee9-b536-19309d97e952', 'volume_name': 'volume-a0299c25-3c29-4ee9-b536-19309d97e952', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f07f90-87cd-455b-b98f-3b2c45a27a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f07f90-87cd-455b-b98f-3b2c45a27a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df35abc8-6902-45e8-b380-896293101690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Volume a0299c25-3c29-4ee9-b536-19309d97e952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0299c25-3c29-4ee9-b536-19309d97e952', 'volume_size': 1} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-559290680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0299c25-3c29-4ee9-b536-19309d97e952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69ab70b37bf5473182238c1b70019f4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:46:19Z,use_quota=True,user_id='997abd569daa4ff9a5bf14d323c98fa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Creating volume a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:46:18 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:46:18 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 1073741824 Jun 23 12:46:18 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Flow 'volume_create_manager' (dfd89c95-3439-4878-a24e-0cf9c8e41699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64002ff1-7fa2-45a4-baa4-0ee723259b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64002ff1-7fa2-45a4-baa4-0ee723259b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-701549078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c606f5-4b2a-4164-babd-60b4453049cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19903ad719434f24bc69171ab5ba7dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:46:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:46:19Z,use_quota=True,user_id='3c29b0342d0b447e908df5485229bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c994d2a5-9178-4aec-a33c-8708c5675cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c994d2a5-9178-4aec-a33c-8708c5675cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da57f2b4-9ac0-48c4-89f6-e3bab2abd04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da57f2b4-9ac0-48c4-89f6-e3bab2abd04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c606f5-4b2a-4164-babd-60b4453049cd', 'volume_name': 'volume-79c606f5-4b2a-4164-babd-60b4453049cd', 'volume_size': 2}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698427ad-006e-491c-a32f-a06d01c31ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698427ad-006e-491c-a32f-a06d01c31ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1d8322-e736-45db-ab07-9799510f9f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:18 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Volume 79c606f5-4b2a-4164-babd-60b4453049cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c606f5-4b2a-4164-babd-60b4453049cd', 'volume_size': 2} Jun 23 12:46:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:19 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 1073741824" returned: 0 in 1.001s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:19 devstack sudo[102088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 Jun 23 12:46:19 devstack sudo[102088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:20 devstack sudo[102088]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952" returned: 0 in 0.653s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-701549078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c606f5-4b2a-4164-babd-60b4453049cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19903ad719434f24bc69171ab5ba7dec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:46:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:46:19Z,use_quota=True,user_id='3c29b0342d0b447e908df5485229bf01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Creating volume 79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:46:20 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd 2147483648 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:20 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd 2147483648 Jun 23 12:46:20 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df35abc8-6902-45e8-b380-896293101690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0299c25-3c29-4ee9-b536-19309d97e952', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff0f828-4b2c-4515-a349-f9c64c66db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:20 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Volume volume-a0299c25-3c29-4ee9-b536-19309d97e952 (a0299c25-3c29-4ee9-b536-19309d97e952): created successfully Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff0f828-4b2c-4515-a349-f9c64c66db24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Flow 'volume_create_manager' (6a391dc4-16b8-4bb5-bb6d-7a1721ddba64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:46:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-f1617f56-3fa7-472a-838d-6942cfe3cc9d req-4d4c0b13-2b26-49c2-a068-989d930f14e2 tempest-VolumesSnapshotsTestJSON-1568555731 None] Created volume successfully. Jun 23 12:46:21 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd 2147483648" returned: 0 in 0.869s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:21 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd Jun 23 12:46:21 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:22 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd" returned: 0 in 0.657s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.302s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1d8322-e736-45db-ab07-9799510f9f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c606f5-4b2a-4164-babd-60b4453049cd', 'volume_size': 2}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862f108f-6fe9-4da6-be2a-1fbdccac70e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Creating offline snapshot b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 of volume a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:46:22 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Volume volume-79c606f5-4b2a-4164-babd-60b4453049cd (79c606f5-4b2a-4164-babd-60b4453049cd): created successfully Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (862f108f-6fe9-4da6-be2a-1fbdccac70e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Flow 'volume_create_manager' (dfd89c95-3439-4878-a24e-0cf9c8e41699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e23866-c98e-4db4-9ebc-3034367c89db]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:22 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4c43a034-797e-45e9-b4bc-25a2a20f67d4 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Created volume successfully. Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:22 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:46:22 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:22 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 Jun 23 12:46:22 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:23 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.818s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:46:23 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952" returned: 0 in 0.866s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:46:23 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 1G Jun 23 12:46:23 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:23 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 1G" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0299c25-3c29-4ee9-b536-19309d97e952 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:23 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0299c25-3c29-4ee9-b536-19309d97e952 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 Jun 23 12:46:23 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:24 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0299c25-3c29-4ee9-b536-19309d97e952 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" returned: 0 in 0.699s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:24 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 is being set with open permissions: ugo+rw Jun 23 12:46:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:24 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 Jun 23 12:46:24 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:25 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" returned: 0 in 0.653s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:25 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.info Jun 23 12:46:25 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:26 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.info" returned: 0 in 0.760s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:26 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.info is being set with open permissions: ugo+rw Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:26 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.info Jun 23 12:46:26 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:26 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.info" returned: 0 in 0.657s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.606s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.996s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Creating offline snapshot f806234e-203b-4dab-b2f7-4489b481abca of volume 79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:46:26 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-06efd8fa-22a2-49dc-bcf4-6d182f887ca3 req-0d258cbc-0a7f-4609-9a72-9a2059724c42 tempest-VolumesSnapshotsTestJSON-1568555731 None] Create snapshot completed successfully Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0caa21d-73a3-4421-9131-f3b1bf714fd4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:26 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd Jun 23 12:46:26 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "cinder-b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "cinder-quobyte-a0299c25-3c29-4ee9-b536-19309d97e952" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-quobyte-a0299c25-3c29-4ee9-b536-19309d97e952" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "cinder-quobyte-b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-quobyte-b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Deleting offline snapshot b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 of volume a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] snapshot_file for this snap is: volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e59655-162c-4ab1-813b-b4b3c284e1eb]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:27 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 Jun 23 12:46:27 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:27 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd" returned: 0 in 0.947s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca 2G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:27 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca 2G Jun 23 12:46:27 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:28 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" returned: 0 in 0.837s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0299c25-3c29-4ee9-b536-19309d97e952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:46:28 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b874c6f-e26c-4d50-8c61-1309c5ba88c4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:28 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 Jun 23 12:46:28 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:28 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca 2G" returned: 0 in 0.853s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c606f5-4b2a-4164-babd-60b4453049cd -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:28 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c606f5-4b2a-4164-babd-60b4453049cd -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca Jun 23 12:46:28 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:29 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952" returned: 0 in 0.753s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:29 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 Jun 23 12:46:29 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:29 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79c606f5-4b2a-4164-babd-60b4453049cd -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca" returned: 0 in 0.701s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:29 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca is being set with open permissions: ugo+rw Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:29 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca Jun 23 12:46:29 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:29 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" returned: 0 in 0.740s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:29 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353 Jun 23 12:46:29 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:29 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca" returned: 0 in 0.631s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:29 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.info Jun 23 12:46:29 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:30 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952.b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" returned: 0 in 0.724s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-quobyte-b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353" released by "_delete_snapshot" :: held 3.173s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:30 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.info" returned: 0 in 0.695s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:30 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.info is being set with open permissions: ugo+rw Jun 23 12:46:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-quobyte-a0299c25-3c29-4ee9-b536-19309d97e952" released by "delete_snapshot" :: held 3.217s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:30 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.info Jun 23 12:46:30 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:30 devstack cinder-volume[93659]: DEBUG cinder.quota [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Created reservations ['0873bd11-f25d-4bac-8603-db0bae86207d', 'f8c058d6-2f08-400d-b508-994b901cb5d6', '628d8c6f-0a48-4bb3-a049-84b67af68fab', 'ccf94247-9213-4d4a-813a-81718bc26984'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:46:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Delete snapshot completed successfully. Jun 23 12:46:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-f6f09e73-0eec-4816-b875-9578a4c8b5bb req-65e74aab-c28b-40e3-ade0-f9f4dfcb1329 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-b9f5f4dd-0a10-48f6-ab85-fcf6cc6e9353-delete_snapshot" released by "delete_snapshot" :: held 3.375s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:31 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.info" returned: 0 in 0.621s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.549s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-86759dfe-2041-490d-b368-7c97c08d7c7e tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Create snapshot completed successfully Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "cinder-a0299c25-3c29-4ee9-b536-19309d97e952-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-a0299c25-3c29-4ee9-b536-19309d97e952-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "cinder-quobyte-a0299c25-3c29-4ee9-b536-19309d97e952" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-quobyte-a0299c25-3c29-4ee9-b536-19309d97e952" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[714678c0-ddcf-4fa8-b7ef-7fb1c9d1ac51]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-9c441833-cc0b-45de-8d12-8c2b987edd8e req-df542104-98b2-4c0d-b5f0-24e08e5fac86 tempest-AttachVolumeTestJSON-430848257 None] Terminate volume connection completed successfully. Jun 23 12:46:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-9c441833-cc0b-45de-8d12-8c2b987edd8e req-df542104-98b2-4c0d-b5f0-24e08e5fac86 tempest-AttachVolumeTestJSON-430848257 None] Deleting attachment 9851da91-c0ab-46b8-8902-7efbd1fb9d51. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:46:32 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 Jun 23 12:46:32 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "cinder-f806234e-203b-4dab-b2f7-4489b481abca-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-f806234e-203b-4dab-b2f7-4489b481abca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "cinder-quobyte-79c606f5-4b2a-4164-babd-60b4453049cd" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-quobyte-79c606f5-4b2a-4164-babd-60b4453049cd" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "cinder-quobyte-f806234e-203b-4dab-b2f7-4489b481abca" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-quobyte-f806234e-203b-4dab-b2f7-4489b481abca" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Deleting offline snapshot f806234e-203b-4dab-b2f7-4489b481abca of volume 79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] snapshot_file for this snap is: volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c15946-6612-493c-a8b3-1b767fd6d46a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:32 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca Jun 23 12:46:32 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:32 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952" returned: 0 in 0.811s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:32 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952 Jun 23 12:46:32 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:33 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca" returned: 0 in 0.942s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79c606f5-4b2a-4164-babd-60b4453049cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1633c6ca-1cc0-4a41-aba5-184ba3490414]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:33 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd Jun 23 12:46:33 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:33 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a0299c25-3c29-4ee9-b536-19309d97e952" returned: 0 in 0.780s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-quobyte-a0299c25-3c29-4ee9-b536-19309d97e952" released by "delete_volume" :: held 1.672s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG cinder.quota [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Created reservations ['9e4156cd-4b15-46ca-a26d-19e22e9ce3f6', '838e9f04-dace-41bc-939f-f71ecdfc362e', 'd028bf9c-a10b-4a45-a4bf-1dd3cc445fd0', '42a92739-f004-48b5-91f0-e2739b3dafa4'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:33 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:46:33 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:34 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd" returned: 0 in 1.172s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:34 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca Jun 23 12:46:34 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:34 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.254s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:34 devstack cinder-volume[93659]: DEBUG cinder.manager [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:46:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Deleted volume successfully. Jun 23 12:46:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-3c71b01f-d913-4d92-97cd-140d9608ad5b req-ab080df1-5087-4197-8bd2-0db9060b0be1 tempest-VolumesSnapshotsTestJSON-1568555731 None] Lock "cinder-a0299c25-3c29-4ee9-b536-19309d97e952-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:35 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca" returned: 0 in 1.419s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:35 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca Jun 23 12:46:35 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:36 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd.f806234e-203b-4dab-b2f7-4489b481abca" returned: 0 in 0.872s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-quobyte-f806234e-203b-4dab-b2f7-4489b481abca" released by "_delete_snapshot" :: held 4.549s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-quobyte-79c606f5-4b2a-4164-babd-60b4453049cd" released by "delete_snapshot" :: held 4.580s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:36 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Created reservations ['dbf5c060-0af3-47a3-ace4-46107a1eea62', '3bf44caa-e021-4791-957d-80dbfa0c6fcf', '956c7ce0-c462-4a8f-9c45-f28af52a3102', '587d2423-9a50-4cea-bf51-e04609e6cf54'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:46:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Delete snapshot completed successfully. Jun 23 12:46:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e9f88538-f8ca-4105-96f3-badbba2a8090 tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-f806234e-203b-4dab-b2f7-4489b481abca-delete_snapshot" released by "delete_snapshot" :: held 4.754s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "cinder-79c606f5-4b2a-4164-babd-60b4453049cd-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-79c606f5-4b2a-4164-babd-60b4453049cd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "cinder-quobyte-79c606f5-4b2a-4164-babd-60b4453049cd" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-quobyte-79c606f5-4b2a-4164-babd-60b4453049cd" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:37 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1021552c-fedf-474b-aa4e-4c55d6149c17]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:37 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd Jun 23 12:46:37 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:38 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd" returned: 0 in 0.834s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:38 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd Jun 23 12:46:38 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:39 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-79c606f5-4b2a-4164-babd-60b4453049cd" returned: 0 in 0.839s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-quobyte-79c606f5-4b2a-4164-babd-60b4453049cd" released by "delete_volume" :: held 1.758s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Created reservations ['889f12df-0efe-4f64-83a3-7db51599ab34', 'fc47a013-90c6-49b6-83f1-300595769b09', '74229d5b-16ca-464c-9d62-33569089f4a6', '1d07ea44-4f5d-4596-b26e-b7c88b6727d2'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:46:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6bda79e5-17bf-479a-b22b-5b971f035455 tempest-GroupSnapshotsTest-1211118739 None] Group tempest-GroupSnapshotsTest-Group-220146279: creating Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:39 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:46:39 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6bda79e5-17bf-479a-b22b-5b971f035455 tempest-GroupSnapshotsTest-1211118739 None] Group tempest-GroupSnapshotsTest-Group-220146279: created successfully Jun 23 12:46:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6bda79e5-17bf-479a-b22b-5b971f035455 tempest-GroupSnapshotsTest-1211118739 None] Create group completed successfully. Jun 23 12:46:40 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.659s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:40 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:46:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Deleted volume successfully. Jun 23 12:46:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44396286-038a-4820-a727-18af3085e1fc tempest-VolumesSnapshotNegativeTestJSON-1231067017 None] Lock "cinder-79c606f5-4b2a-4164-babd-60b4453049cd-delete_volume" released by "delete_volume" :: held 2.719s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (71bf8575-7986-4bc8-93ea-373b62fb2716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab24bb5-dea8-4093-bdc2-7beb89872162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab24bb5-dea8-4093-bdc2-7beb89872162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389907681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8a2a58e-09a3-497a-8139-441b97c33d23,host='devstack@QuobyteHD#QuobyteHD',id=18d9e398-85f1-4d92-bc16-27427fd8d18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:46:42Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9b92bb-00bd-4aa3-afcb-c4b44d37f823),volume_type_id=3d9b92bb-00bd-4aa3-afcb-c4b44d37f823)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece891fb-357f-4810-8f21-53dd895553b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece891fb-357f-4810-8f21-53dd895553b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda59ce4-6227-4d33-9d55-3c0dd9b15312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda59ce4-6227-4d33-9d55-3c0dd9b15312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d9e398-85f1-4d92-bc16-27427fd8d18a', 'volume_name': 'volume-18d9e398-85f1-4d92-bc16-27427fd8d18a', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5a2b0d-7f17-49eb-97be-6ee065cbd172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec5a2b0d-7f17-49eb-97be-6ee065cbd172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f8cd7c-4300-4c6c-89b1-d3cc51e685e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:41 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Volume 18d9e398-85f1-4d92-bc16-27427fd8d18a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d9e398-85f1-4d92-bc16-27427fd8d18a', 'volume_size': 1} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b8a2a58e-09a3-497a-8139-441b97c33d23,created_at=2026-06-23T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1389907681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b8a2a58e-09a3-497a-8139-441b97c33d23,host='devstack@QuobyteHD#QuobyteHD',id=18d9e398-85f1-4d92-bc16-27427fd8d18a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:46:42Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d9b92bb-00bd-4aa3-afcb-c4b44d37f823),volume_type_id=3d9b92bb-00bd-4aa3-afcb-c4b44d37f823)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Creating volume 18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:46:41 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:46:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:41 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a 1073741824 Jun 23 12:46:41 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:43 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a 1073741824" returned: 0 in 1.238s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:43 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a Jun 23 12:46:43 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:44 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a" returned: 0 in 0.849s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:46:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f8cd7c-4300-4c6c-89b1-d3cc51e685e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d9e398-85f1-4d92-bc16-27427fd8d18a', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a0b4ef-ee09-46fc-840d-585134016842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:46:44 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Volume volume-18d9e398-85f1-4d92-bc16-27427fd8d18a (18d9e398-85f1-4d92-bc16-27427fd8d18a): created successfully Jun 23 12:46:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a0b4ef-ee09-46fc-840d-585134016842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:46:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (71bf8575-7986-4bc8-93ea-373b62fb2716) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:46:44 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d44d2304-e09d-4b94-ab99-a660de94f8f0 tempest-GroupSnapshotsTest-1211118739 None] Created volume successfully. Jun 23 12:46:46 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] GroupSnapshot 83d6a370-dfe2-461b-9f93-c7468c189f3c: creating. Jun 23 12:46:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Group snapshot 83d6a370-dfe2-461b-9f93-c7468c189f3c: creating. {{(pid=93659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 12:46:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Creating offline snapshot c59b400e-2173-4061-945e-6dbf36907f0d of volume 18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:46:46 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbc5fbb-dc66-453b-a397-a8f1db188569]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:46 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a Jun 23 12:46:46 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:48 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a" returned: 0 in 1.693s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:48 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d 1G Jun 23 12:46:48 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:49 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d 1G" returned: 0 in 1.599s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d9e398-85f1-4d92-bc16-27427fd8d18a -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:49 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d9e398-85f1-4d92-bc16-27427fd8d18a -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d Jun 23 12:46:49 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:51 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18d9e398-85f1-4d92-bc16-27427fd8d18a -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d" returned: 0 in 1.427s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:51 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:46:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:51 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d Jun 23 12:46:51 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:51 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d" returned: 0 in 0.753s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:51 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:DELETE=6,cinder:UPDATE=62,cinder:SELECT=59,cinder:INSERT=17 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:46:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:51 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.info Jun 23 12:46:51 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:52 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.info" returned: 0 in 0.706s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:52 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:46:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:52 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.info Jun 23 12:46:52 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:53 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.info" returned: 0 in 1.173s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.530s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:53 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=79,cinder:SELECT=76,cinder:INSERT=22,cinder:DELETE=4 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:46:53 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-cdb1287a-f5a0-4666-8ca8-0fecbe0e80c3 tempest-GroupSnapshotsTest-1211118739 None] group_snapshot 83d6a370-dfe2-461b-9f93-c7468c189f3c: created successfully Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-c59b400e-2173-4061-945e-6dbf36907f0d-164d2f38-9508-457e-bab0-6216f16b52f0" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-c59b400e-2173-4061-945e-6dbf36907f0d-164d2f38-9508-457e-bab0-6216f16b52f0" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Creating volume 164d2f38-9508-457e-bab0-6216f16b52f0 from snapshot c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-164d2f38-9508-457e-bab0-6216f16b52f0" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-164d2f38-9508-457e-bab0-6216f16b52f0" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] snapshot: c59b400e-2173-4061-945e-6dbf36907f0d, volume: 164d2f38-9508-457e-bab0-6216f16b52f0, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[06631dc0-7043-45cd-b2ae-4348e76ba906]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:56 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d Jun 23 12:46:56 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:57 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d" returned: 0 in 0.907s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18d9e398-85f1-4d92-bc16-27427fd8d18a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:46:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:46:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:46:57 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beb7515-27dc-4bf9-a21c-e38d03d26636]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:46:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:57 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a Jun 23 12:46:57 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:46:58 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jun 23 12:46:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a" returned: 0 in 1.151s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:46:58 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:46:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:46:58 devstack sudo[102619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 Jun 23 12:46:58 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:05 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0" returned: 0 in 6.672s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:05 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4609731f-9991-4c30-bdda-c4bc785594c2]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:05 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a Jun 23 12:47:05 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:05 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a" returned: 0 in 0.985s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:47:06 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Converted 1024.00 MB image at 153.45 MB/s Jun 23 12:47:06 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=1,cinder:SELECT=3 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:47:06 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 Jun 23 12:47:06 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:47:06 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0" returned: 0 in 0.668s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-164d2f38-9508-457e-bab0-6216f16b52f0" released by "_copy_volume_from_snapshot" :: held 10.561s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-c59b400e-2173-4061-945e-6dbf36907f0d-164d2f38-9508-457e-bab0-6216f16b52f0" released by "_create_volume_from_snapshot" :: held 10.628s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.648s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:06 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-241a2613-e4be-41ef-ab70-602dad4754f3 tempest-GroupSnapshotsTest-1211118739 None] Create group from source-snapshot-83d6a370-dfe2-461b-9f93-c7468c189f3c completed successfully. Jun 23 12:47:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-164d2f38-9508-457e-bab0-6216f16b52f0" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-164d2f38-9508-457e-bab0-6216f16b52f0" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeb8b99-aa05-4bd3-ad16-4feade7ce5b6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:08 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 Jun 23 12:47:08 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Flow 'volume_create_manager' (5f49b9df-8012-4682-80d2-d8b413d99919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3a925b-2d1a-4e34-890d-aa4c4f0498e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3a925b-2d1a-4e34-890d-aa4c4f0498e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-81421965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5663f01f-1b54-46fd-bc91-bd47c044b6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7338e3c17e044fc937d44421d783283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:09Z,use_quota=True,user_id='7f2f037980874b7c929ed13e0d85714b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d10652-fe28-467b-9dcc-e273c458bb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8d10652-fe28-467b-9dcc-e273c458bb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f292c1b8-0af7-41e9-94b1-dc1f868fdf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f292c1b8-0af7-41e9-94b1-dc1f868fdf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5663f01f-1b54-46fd-bc91-bd47c044b6e3', 'volume_name': 'volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3ade2e-6cdf-403d-95b1-6bf8561666aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3ade2e-6cdf-403d-95b1-6bf8561666aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754240cf-4a55-4dd5-af47-54e9f0b8e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:08 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Volume 5663f01f-1b54-46fd-bc91-bd47c044b6e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3', 'volume_size': 1} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-81421965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5663f01f-1b54-46fd-bc91-bd47c044b6e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7338e3c17e044fc937d44421d783283',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:09Z,use_quota=True,user_id='7f2f037980874b7c929ed13e0d85714b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Creating volume 5663f01f-1b54-46fd-bc91-bd47c044b6e3 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:47:08 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:47:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:09 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 1073741824 Jun 23 12:47:09 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0" returned: 0 in 1.519s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:09 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:09 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0 Jun 23 12:47:09 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:10 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-164d2f38-9508-457e-bab0-6216f16b52f0" returned: 0 in 0.824s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:10 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-164d2f38-9508-457e-bab0-6216f16b52f0" released by "delete_volume" :: held 2.410s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 1073741824" returned: 0 in 1.290s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:10 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 Jun 23 12:47:10 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['a6cb0506-4f03-4604-8a02-0e60e0e65ee5'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:10 devstack cinder-volume[93659]: WARNING cinder.quota [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-260756824 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-260756824, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:47:10 devstack cinder-volume[93659]: WARNING cinder.quota [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-260756824 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-260756824, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['581c4211-7ac1-4395-83b2-e94ebd6f8d80', '60656746-01fa-4071-91cd-913d97158ad9', '18648160-fc57-4a8d-abac-b69e6947a883', 'a058c596-a9a1-40b2-84f9-ca1679e41047'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:10 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:47:10 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:11 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3" returned: 0 in 0.838s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.229s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (754240cf-4a55-4dd5-af47-54e9f0b8e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e7fe05-232d-40d4-a654-cf0b50809447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Volume volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 (5663f01f-1b54-46fd-bc91-bd47c044b6e3): created successfully Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e7fe05-232d-40d4-a654-cf0b50809447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Flow 'volume_create_manager' (5f49b9df-8012-4682-80d2-d8b413d99919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9c331317-debc-4b48-858c-78d240ba16a3 tempest-AttachVolumeNegativeTest-1678089407 None] Created volume successfully. Jun 23 12:47:11 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.827s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:11 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:47:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c0c5d60c-1641-4fe2-95a8-d932df3c41a2 tempest-GroupSnapshotsTest-1211118739 None] Delete group completed successfully. Jun 23 12:47:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] group_snapshot 83d6a370-dfe2-461b-9f93-c7468c189f3c: deleting Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] group_snapshot 83d6a370-dfe2-461b-9f93-c7468c189f3c: deleting {{(pid=93659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-18d9e398-85f1-4d92-bc16-27427fd8d18a" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-18d9e398-85f1-4d92-bc16-27427fd8d18a" acquired by "delete_snapshot" :: waited 0.098s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-c59b400e-2173-4061-945e-6dbf36907f0d" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-c59b400e-2173-4061-945e-6dbf36907f0d" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Deleting offline snapshot c59b400e-2173-4061-945e-6dbf36907f0d of volume 18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] snapshot_file for this snap is: volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09951f9-0623-4328-a85e-0dfddbf633b3]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:12 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d Jun 23 12:47:12 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:13 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d" returned: 0 in 1.344s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18d9e398-85f1-4d92-bc16-27427fd8d18a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:47:13 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[686087b7-e4f8-481b-b0db-37460a5ae8f1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:13 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a Jun 23 12:47:13 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:14 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a" returned: 0 in 0.886s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:14 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d Jun 23 12:47:14 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:15 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d" returned: 0 in 0.908s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:15 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d Jun 23 12:47:15 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-eb97eebe-d3f2-4f68-bbca-1d3810f8ae4c req-c96beb60-b260-44cf-a08f-2a569c1ed9e4 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-eb97eebe-d3f2-4f68-bbca-1d3810f8ae4c req-c96beb60-b260-44cf-a08f-2a569c1ed9e4 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:15 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[681ecd2b-75d7-4614-8b17-b0ae443db6c2]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-eb97eebe-d3f2-4f68-bbca-1d3810f8ae4c req-c96beb60-b260-44cf-a08f-2a569c1ed9e4 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:15 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 Jun 23 12:47:15 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:16 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a.c59b400e-2173-4061-945e-6dbf36907f0d" returned: 0 in 0.929s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-c59b400e-2173-4061-945e-6dbf36907f0d" released by "_delete_snapshot" :: held 4.198s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-18d9e398-85f1-4d92-bc16-27427fd8d18a" released by "delete_snapshot" :: held 4.261s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:16 devstack cinder-volume[93659]: WARNING cinder.quota [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-260756824 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-260756824, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:47:16 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['dbfe24b4-ec91-4ab7-968b-612eb202f0aa', 'a9108c5b-6f49-4a04-9c4e-a46a8108c555', 'ddf8f976-a3e0-4525-8637-6fb39b7bdf09', 'bb67dcc5-6254-4a4e-94f6-5504b5ae540d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:16 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-eb97eebe-d3f2-4f68-bbca-1d3810f8ae4c req-c96beb60-b260-44cf-a08f-2a569c1ed9e4 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3" returned: 0 in 0.889s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-eb97eebe-d3f2-4f68-bbca-1d3810f8ae4c req-c96beb60-b260-44cf-a08f-2a569c1ed9e4 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.930s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-eb97eebe-d3f2-4f68-bbca-1d3810f8ae4c req-c96beb60-b260-44cf-a08f-2a569c1ed9e4 tempest-AttachVolumeNegativeTest-1678089407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e712d75-64cf-4e29-ae48-4f761966581d', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:47:16 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-04d2c6f2-2d64-4ace-85d2-26a41e61a4fe tempest-GroupSnapshotsTest-1211118739 None] group_snapshot 83d6a370-dfe2-461b-9f93-c7468c189f3c: deleted successfully Jun 23 12:47:16 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-eb97eebe-d3f2-4f68-bbca-1d3810f8ae4c req-c96beb60-b260-44cf-a08f-2a569c1ed9e4 tempest-AttachVolumeNegativeTest-1678089407 None] attachment_update completed successfully. Jun 23 12:47:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-18d9e398-85f1-4d92-bc16-27427fd8d18a" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-18d9e398-85f1-4d92-bc16-27427fd8d18a" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d37ea0-eea3-4180-93eb-8bb899436612]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:17 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a Jun 23 12:47:17 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:17 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a" returned: 0 in 0.848s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:18 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a Jun 23 12:47:18 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:18 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18d9e398-85f1-4d92-bc16-27427fd8d18a" returned: 0 in 0.848s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-18d9e398-85f1-4d92-bc16-27427fd8d18a" released by "delete_volume" :: held 1.767s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:18 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['29962f2a-7cf1-4b72-9e8a-fffc8a3d3f02'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:18 devstack cinder-volume[93659]: WARNING cinder.db.api [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-260756824'] Jun 23 12:47:18 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['4334b8d2-ad8d-4c9b-a99f-8f0c7bf11311', '457e0385-18f3-41cd-b192-7d67f2fb7ad8', 'a94acc4e-1559-4890-826e-7347241a7228', '18356429-2bcf-4df0-96c8-aceb0a37c6c6'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:19 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:47:19 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:19 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.724s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:19 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:47:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-799da311-0c10-46af-ae73-bdb39006d426 tempest-GroupSnapshotsTest-1211118739 None] Delete group completed successfully. Jun 23 12:47:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-03de27a4-1241-463c-a2c6-2435e9cb6378 tempest-GroupSnapshotsTest-1211118739 None] Group tempest-GroupSnapshotsTest-Group-1466723720: creating Jun 23 12:47:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-03de27a4-1241-463c-a2c6-2435e9cb6378 tempest-GroupSnapshotsTest-1211118739 None] Group tempest-GroupSnapshotsTest-Group-1466723720: created successfully Jun 23 12:47:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-03de27a4-1241-463c-a2c6-2435e9cb6378 tempest-GroupSnapshotsTest-1211118739 None] Create group completed successfully. Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (44153138-72f3-4e15-bc4c-a4dd02fa8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46f311e-59e3-4520-a8bd-7f6d8000d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b46f311e-59e3-4520-a8bd-7f6d8000d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029001153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6faebdcc-dcc3-4ade-b9ed-7670049933cf,host='devstack@QuobyteHD#QuobyteHD',id=1c542c8f-ffce-4a66-be00-097125e214ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:22Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(465c45a9-0bb5-47f9-a36d-63ef54f05d40),volume_type_id=465c45a9-0bb5-47f9-a36d-63ef54f05d40)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2c6355-c1ed-4e97-9076-a1777ad13a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db2c6355-c1ed-4e97-9076-a1777ad13a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bbd8b5-6f3a-40c8-b0f3-c3d88ba896c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bbd8b5-6f3a-40c8-b0f3-c3d88ba896c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c542c8f-ffce-4a66-be00-097125e214ba', 'volume_name': 'volume-1c542c8f-ffce-4a66-be00-097125e214ba', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701f0add-9595-4e22-b6c8-7488758c9522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (701f0add-9595-4e22-b6c8-7488758c9522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552196a1-c769-45ee-a601-0688139dc24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:21 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Volume 1c542c8f-ffce-4a66-be00-097125e214ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c542c8f-ffce-4a66-be00-097125e214ba', 'volume_size': 1} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6faebdcc-dcc3-4ade-b9ed-7670049933cf,created_at=2026-06-23T10:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029001153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6faebdcc-dcc3-4ade-b9ed-7670049933cf,host='devstack@QuobyteHD#QuobyteHD',id=1c542c8f-ffce-4a66-be00-097125e214ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:22Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(465c45a9-0bb5-47f9-a36d-63ef54f05d40),volume_type_id=465c45a9-0bb5-47f9-a36d-63ef54f05d40)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Creating volume 1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:47:21 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:47:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:21 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba 1073741824 Jun 23 12:47:21 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:47:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:22 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:47:22 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:23 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba 1073741824" returned: 0 in 1.184s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:23 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.848s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:23 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba Jun 23 12:47:23 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:23 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-f7b61c98-6648-47b1-aff7-0acdeea1ba38 req-e71321de-102c-4d3c-a738-c8222ecd8df5 tempest-AttachVolumeNegativeTest-1678089407 None] Terminate volume connection completed successfully. Jun 23 12:47:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-f7b61c98-6648-47b1-aff7-0acdeea1ba38 req-e71321de-102c-4d3c-a738-c8222ecd8df5 tempest-AttachVolumeNegativeTest-1678089407 None] Deleting attachment 2e712d75-64cf-4e29-ae48-4f761966581d. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:47:24 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba" returned: 0 in 1.031s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] <== create_volume: return (2306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:47:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.314s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552196a1-c769-45ee-a601-0688139dc24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c542c8f-ffce-4a66-be00-097125e214ba', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0acbc3-3cc1-49a3-a82f-4bbe9157e5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Volume volume-1c542c8f-ffce-4a66-be00-097125e214ba (1c542c8f-ffce-4a66-be00-097125e214ba): created successfully Jun 23 12:47:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b0acbc3-3cc1-49a3-a82f-4bbe9157e5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (44153138-72f3-4e15-bc4c-a4dd02fa8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-69e392c5-b968-460c-af4a-0221221f8b2b tempest-GroupSnapshotsTest-1211118739 None] Created volume successfully. Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (357311a9-23e1-4cd8-84a8-5559057906f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369ccf55-2af2-4264-abc2-40a748c32fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369ccf55-2af2-4264-abc2-40a748c32fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2031520535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6faebdcc-dcc3-4ade-b9ed-7670049933cf,host='devstack@QuobyteHD#QuobyteHD',id=d1652e70-9adf-46f9-887f-e8fde5e411f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:26Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(465c45a9-0bb5-47f9-a36d-63ef54f05d40),volume_type_id=465c45a9-0bb5-47f9-a36d-63ef54f05d40)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8120cdfe-41bb-4736-a7f0-d91b1f3f9ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8120cdfe-41bb-4736-a7f0-d91b1f3f9ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88814d5-9fee-4dd6-86a1-da20b6b9076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88814d5-9fee-4dd6-86a1-da20b6b9076e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1652e70-9adf-46f9-887f-e8fde5e411f8', 'volume_name': 'volume-d1652e70-9adf-46f9-887f-e8fde5e411f8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077793cd-0355-4dc9-8fb8-97a8e39aa5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077793cd-0355-4dc9-8fb8-97a8e39aa5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cff07a-b3ac-42a9-a5cb-fd61c01ff06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Volume d1652e70-9adf-46f9-887f-e8fde5e411f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1652e70-9adf-46f9-887f-e8fde5e411f8', 'volume_size': 1} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6faebdcc-dcc3-4ade-b9ed-7670049933cf,created_at=2026-06-23T10:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2031520535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6faebdcc-dcc3-4ade-b9ed-7670049933cf,host='devstack@QuobyteHD#QuobyteHD',id=d1652e70-9adf-46f9-887f-e8fde5e411f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:26Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(465c45a9-0bb5-47f9-a36d-63ef54f05d40),volume_type_id=465c45a9-0bb5-47f9-a36d-63ef54f05d40)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Creating volume d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:47:26 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:47:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:26 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 1073741824 Jun 23 12:47:26 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:27 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 1073741824" returned: 0 in 1.133s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:27 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 Jun 23 12:47:27 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:28 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8" returned: 0 in 0.719s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:47:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73cff07a-b3ac-42a9-a5cb-fd61c01ff06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1652e70-9adf-46f9-887f-e8fde5e411f8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33f6a3d-288a-481e-a895-764297cfee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:28 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Volume volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 (d1652e70-9adf-46f9-887f-e8fde5e411f8): created successfully Jun 23 12:47:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e33f6a3d-288a-481e-a895-764297cfee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (357311a9-23e1-4cd8-84a8-5559057906f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:28 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0fdd0a86-2202-426e-bf04-e9d38c81242a tempest-GroupSnapshotsTest-1211118739 None] Created volume successfully. Jun 23 12:47:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ea13b82f-7cd3-4b50-b5f7-1a2e5d9a4404 tempest-GroupSnapshotsTest-1211118739 None] Update group completed successfully. Jun 23 12:47:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5be58594-c8b1-4a0f-9f7b-0506f554aa4f tempest-GroupSnapshotsTest-1211118739 None] Update group completed successfully. Jun 23 12:47:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f2f9efa3-486f-4737-b860-e553b136cb7c tempest-GroupSnapshotsTest-1211118739 None] Update group completed successfully. Jun 23 12:47:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b1636fe4-864e-4a4f-b03b-bd3ba9ecd5bd tempest-GroupSnapshotsTest-1211118739 None] Update group completed successfully. Jun 23 12:47:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] GroupSnapshot c4bae539-be7f-4b3b-8d14-395383a99339: creating. Jun 23 12:47:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Group snapshot c4bae539-be7f-4b3b-8d14-395383a99339: creating. {{(pid=93659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 12:47:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Creating offline snapshot 67c726f6-f5c6-4a12-99db-7ebf801e21ab of volume 1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:47:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[57272fb8-e0af-4877-866b-8014bdd6afd7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:35 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba Jun 23 12:47:35 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "cinder-5663f01f-1b54-46fd-bc91-bd47c044b6e3-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-5663f01f-1b54-46fd-bc91-bd47c044b6e3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "cinder-quobyte-5663f01f-1b54-46fd-bc91-bd47c044b6e3" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-quobyte-5663f01f-1b54-46fd-bc91-bd47c044b6e3" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27bc368-bdf2-4cd2-9cdc-c685bf90fd35]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:35 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 Jun 23 12:47:35 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:35 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba" returned: 0 in 1.065s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:35 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab 1G Jun 23 12:47:35 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:36 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3" returned: 0 in 1.161s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:36 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3 Jun 23 12:47:36 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:37 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab 1G" returned: 0 in 1.206s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c542c8f-ffce-4a66-be00-097125e214ba -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:37 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c542c8f-ffce-4a66-be00-097125e214ba -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab Jun 23 12:47:37 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:38 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5663f01f-1b54-46fd-bc91-bd47c044b6e3" returned: 0 in 1.575s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-quobyte-5663f01f-1b54-46fd-bc91-bd47c044b6e3" released by "delete_volume" :: held 2.840s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Created reservations ['acb3a85c-1707-4b9d-bb4a-242b2d0d846d', '8d375b2e-91b0-4b1a-a868-e174d934d5b8', '595e02d4-2b60-4939-8612-12187f9d1d7b', '353c095f-8590-4e01-ac4c-d4bed5b19920'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:38 devstack sudo[103618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:47:38 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:39 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c542c8f-ffce-4a66-be00-097125e214ba -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab" returned: 0 in 2.275s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:39 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "cinder-dfa44317-2048-4754-a6a5-2e8bed3aa3f6-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:39 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab Jun 23 12:47:39 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-dfa44317-2048-4754-a6a5-2e8bed3aa3f6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "cinder-quobyte-dfa44317-2048-4754-a6a5-2e8bed3aa3f6" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Flow 'volume_create_manager' (7b47afb1-5dda-461e-93e7-1f4f7f9cd3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6578aeb9-d63e-49e9-829f-c7c98c1ef20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-quobyte-dfa44317-2048-4754-a6a5-2e8bed3aa3f6" acquired by "delete_volume" :: waited 0.132s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6578aeb9-d63e-49e9-829f-c7c98c1ef20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-359729539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255117b1-225e-4128-9eaa-94064dc6510c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb73071cd3e43b68c93e29c99357e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:40Z,use_quota=True,user_id='cdf9c49cfcc643e7b9929a66f4d80065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc63503-e0bc-4c0f-bc6f-ff61f2f6abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc63503-e0bc-4c0f-bc6f-ff61f2f6abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18608aa1-f950-4e1b-8a1b-53715e0fe711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18608aa1-f950-4e1b-8a1b-53715e0fe711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255117b1-225e-4128-9eaa-94064dc6510c', 'volume_name': 'volume-255117b1-225e-4128-9eaa-94064dc6510c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc859125-f73b-4dc2-8b73-eaa30a09bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc859125-f73b-4dc2-8b73-eaa30a09bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9262259e-9683-4f12-9021-d0cee58ccfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:39 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Volume 255117b1-225e-4128-9eaa-94064dc6510c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255117b1-225e-4128-9eaa-94064dc6510c', 'volume_size': 1} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a515a8d-2623-491e-8101-05bfbd3dd5b6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:40 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 Jun 23 12:47:40 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:40 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.973s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:40 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:47:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Deleted volume successfully. Jun 23 12:47:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0ccc9c1f-27f2-43d3-9fc1-bea2455cefbd tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-5663f01f-1b54-46fd-bc91-bd47c044b6e3-delete_volume" released by "delete_volume" :: held 5.333s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:41 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab" returned: 0 in 1.628s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:41 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.info Jun 23 12:47:41 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:41 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6" returned: 0 in 1.494s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:41 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6 Jun 23 12:47:41 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:42 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.info" returned: 0 in 1.321s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:42 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:42 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:42 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.info Jun 23 12:47:42 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dfa44317-2048-4754-a6a5-2e8bed3aa3f6" returned: 0 in 1.115s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-quobyte-dfa44317-2048-4754-a6a5-2e8bed3aa3f6" released by "delete_volume" :: held 2.769s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Created reservations ['8379946e-8269-45ef-82a3-5a1abb0b974a', 'a547b5f4-33af-4a94-8095-15ded0150b41', '29fd9c4b-3ced-441b-893b-b6c33ab1f1a2', 'ddcc71b9-1c1c-4b6e-bc2e-65ea1837d586'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:43 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:47:43 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:43 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.info" returned: 0 in 1.024s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.701s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "cinder-16bb07a6-f7aa-4614-9e10-ab9b0909afa8-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Creating offline snapshot 906f5355-3e5b-435d-bf5c-8f0221f5ec14 of volume d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-16bb07a6-f7aa-4614-9e10-ab9b0909afa8-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6eaf60-e0dc-414e-acb0-6974bcb219ee]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "cinder-quobyte-16bb07a6-f7aa-4614-9e10-ab9b0909afa8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-quobyte-16bb07a6-f7aa-4614-9e10-ab9b0909afa8" acquired by "delete_volume" :: waited 0.051s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a511c-87ab-4928-9549-372c74aa9a41]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:43 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 Jun 23 12:47:43 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:44 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 Jun 23 12:47:44 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:44 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.542s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:44 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:47:44 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Deleted volume successfully. Jun 23 12:47:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-95be1eec-02af-42ec-ada1-f9c54dbe06e0 tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-dfa44317-2048-4754-a6a5-2e8bed3aa3f6-delete_volume" released by "delete_volume" :: held 5.033s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:45 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8" returned: 0 in 1.316s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:45 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8 Jun 23 12:47:45 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:45 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8" returned: 0 in 1.699s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:45 devstack sudo[103663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 1G Jun 23 12:47:45 devstack sudo[103663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:46 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16bb07a6-f7aa-4614-9e10-ab9b0909afa8" returned: 0 in 0.882s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-quobyte-16bb07a6-f7aa-4614-9e10-ab9b0909afa8" released by "delete_volume" :: held 2.376s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Created reservations ['686d276e-eb20-48cc-804c-8771082ad6fd', '100b755c-7cf5-4ea5-aa25-c752ee52ced2', 'ecfdc5cc-fcf4-41bd-817a-3644924c3e52', '3612f6b3-39d3-4e83-a4c7-4d1ebe853287'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:46 devstack sudo[103698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:47:46 devstack sudo[103698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:46 devstack sudo[103663]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 1G" returned: 0 in 1.514s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:46 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 Jun 23 12:47:46 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:47 devstack sudo[103698]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.726s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:47 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:47:47 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Deleted volume successfully. Jun 23 12:47:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d3435463-b635-415b-82e7-3a199476d36f tempest-AttachVolumeNegativeTest-1678089407 None] Lock "cinder-16bb07a6-f7aa-4614-9e10-ab9b0909afa8-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:47 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14" returned: 0 in 0.798s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:47 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:47:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:47 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 Jun 23 12:47:47 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:48 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14" returned: 0 in 0.702s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:48 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.info Jun 23 12:47:48 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:49 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.info" returned: 0 in 0.843s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:49 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:49 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.info Jun 23 12:47:49 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:49 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.info" returned: 0 in 0.745s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.485s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.101s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-359729539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255117b1-225e-4128-9eaa-94064dc6510c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eb73071cd3e43b68c93e29c99357e82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:47:40Z,use_quota=True,user_id='cdf9c49cfcc643e7b9929a66f4d80065',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Creating volume 255117b1-225e-4128-9eaa-94064dc6510c {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:47:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:47:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:47:50 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:47:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:50 devstack sudo[103720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c 1073741824 Jun 23 12:47:50 devstack sudo[103720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-16939199-010d-4016-bc2b-f3b873fbac91 tempest-GroupSnapshotsTest-1211118739 None] group_snapshot c4bae539-be7f-4b3b-8d14-395383a99339: created successfully Jun 23 12:47:51 devstack sudo[103720]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c 1073741824" returned: 0 in 1.089s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:51 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c Jun 23 12:47:51 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:51 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] group_snapshot c4bae539-be7f-4b3b-8d14-395383a99339: deleting Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] group_snapshot c4bae539-be7f-4b3b-8d14-395383a99339: deleting {{(pid=93659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-1c542c8f-ffce-4a66-be00-097125e214ba" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-1c542c8f-ffce-4a66-be00-097125e214ba" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-67c726f6-f5c6-4a12-99db-7ebf801e21ab" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-67c726f6-f5c6-4a12-99db-7ebf801e21ab" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Deleting offline snapshot 67c726f6-f5c6-4a12-99db-7ebf801e21ab of volume 1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] snapshot_file for this snap is: volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b23d54-e6fc-4acf-98c7-50ec21859360]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:51 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab Jun 23 12:47:51 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:52 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c" returned: 0 in 1.020s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9262259e-9683-4f12-9021-d0cee58ccfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255117b1-225e-4128-9eaa-94064dc6510c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ce5f2a-56a7-49c3-92a3-3191c46ed923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:47:52 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Volume volume-255117b1-225e-4128-9eaa-94064dc6510c (255117b1-225e-4128-9eaa-94064dc6510c): created successfully Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ce5f2a-56a7-49c3-92a3-3191c46ed923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Flow 'volume_create_manager' (7b47afb1-5dda-461e-93e7-1f4f7f9cd3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:47:52 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5e29e6a3-aa5e-4d40-955e-14ca1c44e5e5 tempest-TestMinimumBasicScenario-558636926 None] Created volume successfully. Jun 23 12:47:52 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab" returned: 0 in 1.014s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c542c8f-ffce-4a66-be00-097125e214ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff3be5f-55ce-4284-b40a-a1b0b051217d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:52 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba Jun 23 12:47:52 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:53 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba" returned: 0 in 1.137s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:53 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab Jun 23 12:47:53 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:54 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab" returned: 0 in 0.795s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:54 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab Jun 23 12:47:54 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:55 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba.67c726f6-f5c6-4a12-99db-7ebf801e21ab" returned: 0 in 0.709s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-67c726f6-f5c6-4a12-99db-7ebf801e21ab" released by "_delete_snapshot" :: held 3.787s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-1c542c8f-ffce-4a66-be00-097125e214ba" released by "delete_snapshot" :: held 3.818s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-d1652e70-9adf-46f9-887f-e8fde5e411f8" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-d1652e70-9adf-46f9-887f-e8fde5e411f8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-906f5355-3e5b-435d-bf5c-8f0221f5ec14" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-906f5355-3e5b-435d-bf5c-8f0221f5ec14" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Deleting offline snapshot 906f5355-3e5b-435d-bf5c-8f0221f5ec14 of volume d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] snapshot_file for this snap is: volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ab1792-68d1-4547-b286-dc6cba2a103d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:55 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 Jun 23 12:47:55 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:56 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14" returned: 0 in 0.822s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1652e70-9adf-46f9-887f-e8fde5e411f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[331fafa9-8627-48a4-8584-c3fdaf9a5a25]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:56 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 Jun 23 12:47:56 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-175d9425-4d3d-4181-9276-cc3a9e3ba4bf req-fd3ad5de-9551-42d3-b525-d5ec14d48748 tempest-TestMinimumBasicScenario-558636926 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-175d9425-4d3d-4181-9276-cc3a9e3ba4bf req-fd3ad5de-9551-42d3-b525-d5ec14d48748 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d87163-0be5-4067-b896-52235dacd533]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-175d9425-4d3d-4181-9276-cc3a9e3ba4bf req-fd3ad5de-9551-42d3-b525-d5ec14d48748 tempest-TestMinimumBasicScenario-558636926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:56 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c Jun 23 12:47:56 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:57 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8" returned: 0 in 0.902s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:57 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 Jun 23 12:47:57 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:57 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-175d9425-4d3d-4181-9276-cc3a9e3ba4bf req-fd3ad5de-9551-42d3-b525-d5ec14d48748 tempest-TestMinimumBasicScenario-558636926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c" returned: 0 in 0.911s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-175d9425-4d3d-4181-9276-cc3a9e3ba4bf req-fd3ad5de-9551-42d3-b525-d5ec14d48748 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.935s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:47:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-175d9425-4d3d-4181-9276-cc3a9e3ba4bf req-fd3ad5de-9551-42d3-b525-d5ec14d48748 tempest-TestMinimumBasicScenario-558636926 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-255117b1-225e-4128-9eaa-94064dc6510c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73a1fa64-36fe-498b-b630-3d8e762591ff', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:47:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-175d9425-4d3d-4181-9276-cc3a9e3ba4bf req-fd3ad5de-9551-42d3-b525-d5ec14d48748 tempest-TestMinimumBasicScenario-558636926 None] attachment_update completed successfully. Jun 23 12:47:57 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14" returned: 0 in 0.765s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:57 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14 Jun 23 12:47:57 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:47:58 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Jun 23 12:47:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8.906f5355-3e5b-435d-bf5c-8f0221f5ec14" returned: 0 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:47:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-906f5355-3e5b-435d-bf5c-8f0221f5ec14" released by "_delete_snapshot" :: held 3.348s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-d1652e70-9adf-46f9-887f-e8fde5e411f8" released by "delete_snapshot" :: held 3.377s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:47:58 devstack cinder-volume[93659]: WARNING cinder.quota [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1511686618 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1511686618, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:47:58 devstack cinder-volume[93659]: WARNING cinder.quota [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1511686618 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1511686618, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:47:58 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['f2e80daf-fb44-41a6-ab15-0edb3b977edb', '61033059-864a-404e-bd25-e35fe972895d', '7cff28a7-0d51-4736-8437-754a173f8165', '018e16a2-2ccf-42bc-9b92-0261612a2464'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:58 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['acbe090c-7894-4920-bfec-c3cb8b99fd0d', '0273501e-043a-42fc-9476-da6f048fe9f6', '79f8c22c-049d-45a4-b4f9-2e83809cda47', 'b3797e22-505b-48e2-869a-f8fda359049d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:47:59 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4ec38a80-d7e9-44c3-9987-6ab3e7231788 tempest-GroupSnapshotsTest-1211118739 None] group_snapshot c4bae539-be7f-4b3b-8d14-395383a99339: deleted successfully Jun 23 12:47:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-1c542c8f-ffce-4a66-be00-097125e214ba" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:47:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-1c542c8f-ffce-4a66-be00-097125e214ba" acquired by "delete_volume" :: waited 0.033s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:47:59 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6423b4e1-5268-4a52-afc6-393306bc9ad0]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:47:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:47:59 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba Jun 23 12:47:59 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:00 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba" returned: 0 in 0.888s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:00 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba Jun 23 12:48:00 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:01 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c542c8f-ffce-4a66-be00-097125e214ba" returned: 0 in 0.770s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-1c542c8f-ffce-4a66-be00-097125e214ba" released by "delete_volume" :: held 1.752s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-d1652e70-9adf-46f9-887f-e8fde5e411f8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-d1652e70-9adf-46f9-887f-e8fde5e411f8" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8c6b72-53b2-4019-815f-67ecae974466]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:01 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 Jun 23 12:48:01 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:02 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8" returned: 0 in 0.899s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:02 devstack sudo[104207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8 Jun 23 12:48:02 devstack sudo[104207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:03 devstack sudo[104207]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d1652e70-9adf-46f9-887f-e8fde5e411f8" returned: 0 in 0.690s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-d1652e70-9adf-46f9-887f-e8fde5e411f8" released by "delete_volume" :: held 1.657s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['8260c6ff-9638-4535-b7f1-a109af64a95d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:03 devstack cinder-volume[93659]: WARNING cinder.quota [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1511686618 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1511686618, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['5d83b443-fd1e-4472-986c-fa337626f74f', '99418d8f-d96f-4f10-bc6b-97d840fee929', '310d5d06-2975-4c9b-a5f0-17e4d562f617', '4656c76d-3eb3-4c3d-a625-5e477633e164'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['02d194e5-873d-44f4-b4f9-bdb4455753f4', 'b4b16d51-5268-44a4-9e9d-f03f8d34f51d', 'a6cf225d-46eb-4066-a171-b3a6a274a492', 'df60d9ee-9b57-4774-a3d0-9032651d4099'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:03 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:48:03 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:04 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.670s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:04 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:48:04 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7e28c453-2936-403d-bb5b-594cd45d0215 tempest-GroupSnapshotsTest-1211118739 None] Delete group completed successfully. Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Flow 'volume_create_manager' (fafa7f18-02d8-4e3a-bb17-3416bab57bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e398f7-2ebe-49f9-8eac-5f0f8b01ae53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e398f7-2ebe-49f9-8eac-5f0f8b01ae53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-598178088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4fc120-5a79-4aa9-961a-911a74d11d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707d55d30f845c3ae0740142e1d61b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:05Z,use_quota=True,user_id='666c8cd9c2b640f9a72487067743b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e6b33c-0438-462a-a9d9-590d8bf9d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e6b33c-0438-462a-a9d9-590d8bf9d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1913a63c-48e3-4767-acfd-fd31015d3ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1913a63c-48e3-4767-acfd-fd31015d3ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b4fc120-5a79-4aa9-961a-911a74d11d65', 'volume_name': 'volume-2b4fc120-5a79-4aa9-961a-911a74d11d65', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a03afba-c97e-4bce-829f-4b83c3a26547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a03afba-c97e-4bce-829f-4b83c3a26547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce84f0f-c51e-48ac-9009-850f3a6f3484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:05 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Volume 2b4fc120-5a79-4aa9-961a-911a74d11d65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b4fc120-5a79-4aa9-961a-911a74d11d65', 'volume_size': 1} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-598178088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b4fc120-5a79-4aa9-961a-911a74d11d65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707d55d30f845c3ae0740142e1d61b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:05Z,use_quota=True,user_id='666c8cd9c2b640f9a72487067743b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Creating volume 2b4fc120-5a79-4aa9-961a-911a74d11d65 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:48:05 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:48:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:05 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 1073741824 Jun 23 12:48:05 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ea4f357e-4663-49aa-9625-312fca974765 tempest-GroupSnapshotsTest-1211118739 None] Group tempest-GroupSnapshotsTest-Group-629540036: creating Jun 23 12:48:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ea4f357e-4663-49aa-9625-312fca974765 tempest-GroupSnapshotsTest-1211118739 None] Group tempest-GroupSnapshotsTest-Group-629540036: created successfully Jun 23 12:48:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ea4f357e-4663-49aa-9625-312fca974765 tempest-GroupSnapshotsTest-1211118739 None] Create group completed successfully. Jun 23 12:48:06 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 1073741824" returned: 0 in 1.189s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:06 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=105,cinder:SELECT=120,cinder:INSERT=25,cinder:DELETE=5 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:48:06 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=113,cinder:SELECT=92,cinder:INSERT=24,cinder:DELETE=2 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:48:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:06 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 Jun 23 12:48:06 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:48:07 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (3e4c011a-b8fe-436b-8605-a85ef6e9001f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df11cd-663d-4f91-bc08-44ff5a0e0c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65" returned: 0 in 1.108s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] <== create_volume: return (2392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4df11cd-663d-4f91-bc08-44ff5a0e0c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745779026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0d9153f-77e1-4815-bec9-53bbddad53d7,host='devstack@QuobyteHD#QuobyteHD',id=17973478-17fd-4c35-aa72-e1351074b5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:07Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5c17a60-c95a-4dcf-b2be-53f541134d76),volume_type_id=a5c17a60-c95a-4dcf-b2be-53f541134d76)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4714cb4-089a-4fad-9f15-ea6d012e43e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4714cb4-089a-4fad-9f15-ea6d012e43e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4065fe5-5d88-46e7-a150-14277a75edfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4065fe5-5d88-46e7-a150-14277a75edfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17973478-17fd-4c35-aa72-e1351074b5c2', 'volume_name': 'volume-17973478-17fd-4c35-aa72-e1351074b5c2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787fae33-7bbb-4023-95e3-e6af0dfcc814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787fae33-7bbb-4023-95e3-e6af0dfcc814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8475387f-30c3-48c2-94b8-c879e192891e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:07 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Volume 17973478-17fd-4c35-aa72-e1351074b5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17973478-17fd-4c35-aa72-e1351074b5c2', 'volume_size': 1} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e0d9153f-77e1-4815-bec9-53bbddad53d7,created_at=2026-06-23T10:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-745779026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e0d9153f-77e1-4815-bec9-53bbddad53d7,host='devstack@QuobyteHD#QuobyteHD',id=17973478-17fd-4c35-aa72-e1351074b5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e2865512f14ee287e06ac659ec2378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:07Z,use_quota=True,user_id='226dd6c17957423b8d8fa419da191720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a5c17a60-c95a-4dcf-b2be-53f541134d76),volume_type_id=a5c17a60-c95a-4dcf-b2be-53f541134d76)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Creating volume 17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:48:07 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce84f0f-c51e-48ac-9009-850f3a6f3484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b4fc120-5a79-4aa9-961a-911a74d11d65', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8b1664-6a06-4d08-9fdc-30a8a177467f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:07 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 1073741824 Jun 23 12:48:07 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:07 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Volume volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 (2b4fc120-5a79-4aa9-961a-911a74d11d65): created successfully Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc8b1664-6a06-4d08-9fdc-30a8a177467f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Flow 'volume_create_manager' (fafa7f18-02d8-4e3a-bb17-3416bab57bb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-fdc51747-a7ca-4bbb-a991-7fa680dd5924 tempest-AttachVolumeTestJSON-430848257 None] Created volume successfully. Jun 23 12:48:08 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 1073741824" returned: 0 in 1.094s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:08 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 Jun 23 12:48:08 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:09 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2" returned: 0 in 0.765s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:48:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8475387f-30c3-48c2-94b8-c879e192891e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17973478-17fd-4c35-aa72-e1351074b5c2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b86b2a4-a653-475e-b3b4-52e6087ec0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:09 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Volume volume-17973478-17fd-4c35-aa72-e1351074b5c2 (17973478-17fd-4c35-aa72-e1351074b5c2): created successfully Jun 23 12:48:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b86b2a4-a653-475e-b3b4-52e6087ec0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Flow 'volume_create_manager' (3e4c011a-b8fe-436b-8605-a85ef6e9001f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-3b90a4c7-77f7-42f8-9a8f-431edff72449 tempest-GroupSnapshotsTest-1211118739 None] Created volume successfully. Jun 23 12:48:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] GroupSnapshot b0ab3e65-8407-4231-a5d5-afbf53d33fc3: creating. Jun 23 12:48:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Group snapshot b0ab3e65-8407-4231-a5d5-afbf53d33fc3: creating. {{(pid=93659) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 12:48:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Creating offline snapshot e5b6b417-29b1-4fd3-83cc-b1c4fccef304 of volume 17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:48:10 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c186b1da-3007-4bc4-90f1-80faf9f2860b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:10 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 Jun 23 12:48:10 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:11 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2" returned: 0 in 0.925s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:11 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 1G Jun 23 12:48:11 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9eef4a50-dc57-480e-9a5a-1950b97bb208 req-2f988bcf-2cb1-4058-bd06-4309df3f0d49 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:12 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 1G" returned: 0 in 0.904s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17973478-17fd-4c35-aa72-e1351074b5c2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:12 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17973478-17fd-4c35-aa72-e1351074b5c2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 Jun 23 12:48:12 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:12 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17973478-17fd-4c35-aa72-e1351074b5c2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304" returned: 0 in 0.744s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:12 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:48:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:12 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 Jun 23 12:48:12 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:12 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Flow 'volume_create_manager' (3509e676-8c8f-4bac-9ab3-106468622b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e60c6-6006-4ac1-a590-5b9be571ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b3e60c6-6006-4ac1-a590-5b9be571ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-896786010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee3ac79-e6e6-4c96-9bec-b537fe295d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c6df68bfa241d7ada09746ae855aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:13Z,use_quota=True,user_id='b5d2889dac6c470caddf292579e8b7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d958bd56-220b-4ef0-ac71-11a41d67cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d958bd56-220b-4ef0-ac71-11a41d67cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8df0153-27ca-4a97-945c-b698e71313b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8df0153-27ca-4a97-945c-b698e71313b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee3ac79-e6e6-4c96-9bec-b537fe295d48', 'volume_name': 'volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef04e08c-cfd5-41ab-b9a1-5ce5d4cc3db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef04e08c-cfd5-41ab-b9a1-5ce5d4cc3db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118195ec-182e-461a-b3ab-51866da6f60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:13 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Volume cee3ac79-e6e6-4c96-9bec-b537fe295d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48', 'volume_size': 1} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:13 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304" returned: 0 in 0.633s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:13 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.info Jun 23 12:48:13 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:14 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.info" returned: 0 in 0.656s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:14 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:48:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:14 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.info Jun 23 12:48:14 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:14 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.info" returned: 0 in 0.650s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.634s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9eef4a50-dc57-480e-9a5a-1950b97bb208 req-2f988bcf-2cb1-4058-bd06-4309df3f0d49 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.511s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:14 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc410a4-3172-46dd-a2e2-fb925b19ce33]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9eef4a50-dc57-480e-9a5a-1950b97bb208 req-2f988bcf-2cb1-4058-bd06-4309df3f0d49 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:14 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-32600437-bf77-4af7-a83a-d048a24adf4c tempest-GroupSnapshotsTest-1211118739 None] group_snapshot b0ab3e65-8407-4231-a5d5-afbf53d33fc3: created successfully Jun 23 12:48:15 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 Jun 23 12:48:15 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:15 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9eef4a50-dc57-480e-9a5a-1950b97bb208 req-2f988bcf-2cb1-4058-bd06-4309df3f0d49 tempest-AttachVolumeTestJSON-430848257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65" returned: 0 in 0.757s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9eef4a50-dc57-480e-9a5a-1950b97bb208 req-2f988bcf-2cb1-4058-bd06-4309df3f0d49 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.779s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-896786010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee3ac79-e6e6-4c96-9bec-b537fe295d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61c6df68bfa241d7ada09746ae855aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:13Z,use_quota=True,user_id='b5d2889dac6c470caddf292579e8b7b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Creating volume cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:48:15 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:15 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 1073741824 Jun 23 12:48:15 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-9eef4a50-dc57-480e-9a5a-1950b97bb208 req-2f988bcf-2cb1-4058-bd06-4309df3f0d49 tempest-AttachVolumeTestJSON-430848257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-2b4fc120-5a79-4aa9-961a-911a74d11d65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e960e61c-4502-41cf-9846-99c870a42f0a', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:48:15 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-9eef4a50-dc57-480e-9a5a-1950b97bb208 req-2f988bcf-2cb1-4058-bd06-4309df3f0d49 tempest-AttachVolumeTestJSON-430848257 None] attachment_update completed successfully. Jun 23 12:48:16 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] group_snapshot b0ab3e65-8407-4231-a5d5-afbf53d33fc3: deleting Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] group_snapshot b0ab3e65-8407-4231-a5d5-afbf53d33fc3: deleting {{(pid=93659) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-17973478-17fd-4c35-aa72-e1351074b5c2" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-17973478-17fd-4c35-aa72-e1351074b5c2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-e5b6b417-29b1-4fd3-83cc-b1c4fccef304" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-e5b6b417-29b1-4fd3-83cc-b1c4fccef304" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Deleting offline snapshot e5b6b417-29b1-4fd3-83cc-b1c4fccef304 of volume 17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] snapshot_file for this snap is: volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[21da2338-9bfa-440f-a4f6-65d0470bc2a6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:16 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 Jun 23 12:48:16 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:16 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 1073741824" returned: 0 in 0.909s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:16 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 Jun 23 12:48:16 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:17 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304" returned: 0 in 0.967s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17973478-17fd-4c35-aa72-e1351074b5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[29aaae65-f960-4a70-9856-58c0976944b9]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:17 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 Jun 23 12:48:17 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:17 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48" returned: 0 in 0.841s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (118195ec-182e-461a-b3ab-51866da6f60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3514e226-3daf-42de-8749-5662d2d1d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:17 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Volume volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 (cee3ac79-e6e6-4c96-9bec-b537fe295d48): created successfully Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3514e226-3daf-42de-8749-5662d2d1d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Flow 'volume_create_manager' (3509e676-8c8f-4bac-9ab3-106468622b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b110ca74-78c2-4a97-81b2-2c440d6170b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Created volume successfully. Jun 23 12:48:17 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2" returned: 0 in 0.776s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:17 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 Jun 23 12:48:17 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Creating offline snapshot cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 of volume cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:48:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5b4087-87b6-4e38-b21e-6a98df7e7a7a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:18 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 Jun 23 12:48:18 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:18 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304" returned: 0 in 0.754s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:18 devstack sudo[104371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304 Jun 23 12:48:18 devstack sudo[104371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:19 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48" returned: 0 in 0.924s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:19 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 1G Jun 23 12:48:19 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:19 devstack sudo[104371]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2.e5b6b417-29b1-4fd3-83cc-b1c4fccef304" returned: 0 in 0.969s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-e5b6b417-29b1-4fd3-83cc-b1c4fccef304" released by "_delete_snapshot" :: held 3.568s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-17973478-17fd-4c35-aa72-e1351074b5c2" released by "delete_snapshot" :: held 3.594s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:19 devstack cinder-volume[93659]: WARNING cinder.quota [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-448015832 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-448015832, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:48:19 devstack cinder-volume[93659]: WARNING cinder.quota [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-448015832 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-448015832, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:48:19 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['b3dcb255-5e79-4c84-ae5a-afb9b9279b1f', 'a2f85b1e-1e1d-4f6b-bc11-9a76dd876fdb', 'fef85f9e-1001-4c61-a6ac-78a45bda37b5', '29982b12-9a87-4bc8-afa2-7e40cd74244d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6091aae1-5cfc-4f21-a634-a6651d017a6e tempest-GroupSnapshotsTest-1211118739 None] group_snapshot b0ab3e65-8407-4231-a5d5-afbf53d33fc3: deleted successfully Jun 23 12:48:20 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 1G" returned: 0 in 1.023s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:20 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 Jun 23 12:48:20 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "cinder-quobyte-17973478-17fd-4c35-aa72-e1351074b5c2" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-17973478-17fd-4c35-aa72-e1351074b5c2" acquired by "delete_volume" :: waited 0.033s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18cec88-446b-4f22-8742-873076cf459c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:21 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 Jun 23 12:48:21 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:21 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" returned: 0 in 1.417s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:21 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 is being set with open permissions: ugo+rw Jun 23 12:48:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:21 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 Jun 23 12:48:21 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:48:22 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:48:22 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Flow 'volume_create_manager' (fcbb7b00-15dd-4411-b40a-0a85a01fd74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a969b437-2331-4301-bb68-2a4a81c1827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a969b437-2331-4301-bb68-2a4a81c1827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1423955452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fd5da1-6617-4672-aa9b-ab42be7f88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707d55d30f845c3ae0740142e1d61b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:22Z,use_quota=True,user_id='666c8cd9c2b640f9a72487067743b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca996db-fbf9-4ed9-8db4-26622921f516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca996db-fbf9-4ed9-8db4-26622921f516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4007b446-9049-481a-8ba9-b345187ecf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4007b446-9049-481a-8ba9-b345187ecf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fd5da1-6617-4672-aa9b-ab42be7f88a8', 'volume_name': 'volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934d4a58-250b-4c6c-958a-aba9f8624854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934d4a58-250b-4c6c-958a-aba9f8624854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793474a8-322d-4ba9-8abb-743a0fb0f831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:22 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Volume 59fd5da1-6617-4672-aa9b-ab42be7f88a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8', 'volume_size': 1} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:22 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2" returned: 0 in 1.493s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:22 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" returned: 0 in 1.021s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:22 devstack sudo[104523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2 Jun 23 12:48:22 devstack sudo[104523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:22 devstack sudo[104525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.info Jun 23 12:48:22 devstack sudo[104525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:23 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.219s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:48:23 devstack sudo[104523]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-17973478-17fd-4c35-aa72-e1351074b5c2" returned: 0 in 0.813s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Lock "cinder-quobyte-17973478-17fd-4c35-aa72-e1351074b5c2" released by "delete_volume" :: held 2.441s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['80a7cd50-e7d2-4784-8f20-5141546b2616'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:23 devstack cinder-volume[93659]: WARNING cinder.quota [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-448015832 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-448015832, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Created reservations ['9d175d02-81ce-476a-8ff5-639e5175ee1c', '87f95e83-8d7f-4d8f-8a0e-0ad770256a3f', '99a4ef49-3b53-42b7-b76d-2d13c6fb5122', '0b695533-dc89-4275-ad13-e1987ab0d9fa'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:23 devstack sudo[104525]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.info" returned: 0 in 0.938s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:23 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.info is being set with open permissions: ugo+rw Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:23 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.info Jun 23 12:48:23 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:24 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:48:24 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:24 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.info" returned: 0 in 0.851s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.304s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.332s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1423955452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fd5da1-6617-4672-aa9b-ab42be7f88a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4707d55d30f845c3ae0740142e1d61b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:48:22Z,use_quota=True,user_id='666c8cd9c2b640f9a72487067743b39f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Creating volume 59fd5da1-6617-4672-aa9b-ab42be7f88a8 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:48:24 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d9104a9d-39f3-42af-916a-1d2d9fc41564 tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Create snapshot completed successfully Jun 23 12:48:24 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 1073741824 Jun 23 12:48:24 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:24 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.870s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:24 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:48:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6ccb9842-5bc7-4462-b5f6-c2e8b3d89545 tempest-GroupSnapshotsTest-1211118739 None] Delete group completed successfully. Jun 23 12:48:25 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 1073741824" returned: 0 in 1.096s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:25 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 Jun 23 12:48:25 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "cinder-cb0c41e2-f86e-49e0-91cf-1e51cf8fb743-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-cb0c41e2-f86e-49e0-91cf-1e51cf8fb743-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "cinder-quobyte-cee3ac79-e6e6-4c96-9bec-b537fe295d48" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-quobyte-cee3ac79-e6e6-4c96-9bec-b537fe295d48" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "cinder-quobyte-cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-quobyte-cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:26 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Deleting offline snapshot cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 of volume cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] snapshot_file for this snap is: volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8" returned: 0 in 1.010s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] <== create_volume: return (2184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4a788d-9cff-4666-8cac-ef8f50949564]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793474a8-322d-4ba9-8abb-743a0fb0f831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16effbee-c63f-4038-a190-12579b74470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:48:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Volume volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 (59fd5da1-6617-4672-aa9b-ab42be7f88a8): created successfully Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16effbee-c63f-4038-a190-12579b74470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:48:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Flow 'volume_create_manager' (fcbb7b00-15dd-4411-b40a-0a85a01fd74f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:48:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2c04f805-b776-49ac-aa48-4015100dda08 tempest-AttachVolumeTestJSON-430848257 None] Created volume successfully. Jun 23 12:48:27 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 Jun 23 12:48:27 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:28 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" returned: 0 in 1.225s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:48:28 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d679c450-3368-410f-afae-41cd1cd4fee4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:28 devstack sudo[104579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 Jun 23 12:48:28 devstack sudo[104579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:29 devstack sudo[104579]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48" returned: 0 in 0.868s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:29 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 Jun 23 12:48:29 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:29 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" returned: 0 in 0.866s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:29 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743 Jun 23 12:48:29 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:30 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48.cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" returned: 0 in 0.812s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-quobyte-cb0c41e2-f86e-49e0-91cf-1e51cf8fb743" released by "_delete_snapshot" :: held 3.905s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-quobyte-cee3ac79-e6e6-4c96-9bec-b537fe295d48" released by "delete_snapshot" :: held 3.936s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:30 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Created reservations ['605087fe-d8f0-4a09-b09a-3bd0b39fdd7b', '9a0ac3f2-6607-4b87-ba9c-6821dfa07d13', 'c288ee46-1268-4b87-9311-3f04677a6bff', 'ce5cf07e-95e8-4878-b580-0f6a2afb4d21'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Delete snapshot completed successfully. Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2525ef68-a75c-451d-8dc4-ca316f53a5cc tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-cb0c41e2-f86e-49e0-91cf-1e51cf8fb743-delete_snapshot" released by "delete_snapshot" :: held 4.184s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a5ddd607-fa60-4186-a7fe-87b8b48de8da req-f13795d5-449f-4ced-b2f9-d73dd0405dc9 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a5ddd607-fa60-4186-a7fe-87b8b48de8da req-f13795d5-449f-4ced-b2f9-d73dd0405dc9 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b7401-d217-419c-b638-218e66c43449]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-a5ddd607-fa60-4186-a7fe-87b8b48de8da req-f13795d5-449f-4ced-b2f9-d73dd0405dc9 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "cinder-cee3ac79-e6e6-4c96-9bec-b537fe295d48-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-cee3ac79-e6e6-4c96-9bec-b537fe295d48-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "cinder-quobyte-cee3ac79-e6e6-4c96-9bec-b537fe295d48" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-quobyte-cee3ac79-e6e6-4c96-9bec-b537fe295d48" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:31 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 Jun 23 12:48:31 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6af5da-30fb-45c2-b87a-54d6d4a1c58e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:31 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 Jun 23 12:48:31 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:32 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-a5ddd607-fa60-4186-a7fe-87b8b48de8da req-f13795d5-449f-4ced-b2f9-d73dd0405dc9 tempest-AttachVolumeTestJSON-430848257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8" returned: 0 in 0.965s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-a5ddd607-fa60-4186-a7fe-87b8b48de8da req-f13795d5-449f-4ced-b2f9-d73dd0405dc9 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.991s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-a5ddd607-fa60-4186-a7fe-87b8b48de8da req-f13795d5-449f-4ced-b2f9-d73dd0405dc9 tempest-AttachVolumeTestJSON-430848257 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce97a80b-c06c-4ee1-bd82-13b82890cd95', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:48:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-a5ddd607-fa60-4186-a7fe-87b8b48de8da req-f13795d5-449f-4ced-b2f9-d73dd0405dc9 tempest-AttachVolumeTestJSON-430848257 None] attachment_update completed successfully. Jun 23 12:48:32 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48" returned: 0 in 1.179s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:32 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48 Jun 23 12:48:32 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:33 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cee3ac79-e6e6-4c96-9bec-b537fe295d48" returned: 0 in 0.775s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-quobyte-cee3ac79-e6e6-4c96-9bec-b537fe295d48" released by "delete_volume" :: held 2.040s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Created reservations ['14293ef8-8208-463d-9865-604727ecdbfb', 'b9ce6575-efb5-4248-b285-f9a65e612709', '87e37e35-aeff-4ca7-af4a-0d66381c1309', '5150a3b4-6c2a-486c-a163-f33646d691e6'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:33 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:48:33 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:34 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.167s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:34 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:48:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Deleted volume successfully. Jun 23 12:48:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4544e486-f8c3-4e22-9a0b-442f9349f88b tempest-VolumeSnapshotQuotasNegativeTestJSON-60919065 None] Lock "cinder-cee3ac79-e6e6-4c96-9bec-b537fe295d48-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c95cb788-b0fc-4321-8b4c-6fe518f0fa98 tempest-GroupsV320Test-85022560 None] Group tempest-GroupsV320Test-Group-215013743: creating Jun 23 12:48:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c95cb788-b0fc-4321-8b4c-6fe518f0fa98 tempest-GroupsV320Test-85022560 None] Group tempest-GroupsV320Test-Group-215013743: created successfully Jun 23 12:48:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c95cb788-b0fc-4321-8b4c-6fe518f0fa98 tempest-GroupsV320Test-85022560 None] Create group completed successfully. Jun 23 12:48:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-0f90f1d7-4233-4495-bcda-8afb90ae1c84 req-bdfb45ee-95db-4413-ae19-ba04afb6d7e1 tempest-AttachVolumeTestJSON-430848257 None] Terminate volume connection completed successfully. Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-0f90f1d7-4233-4495-bcda-8afb90ae1c84 req-bdfb45ee-95db-4413-ae19-ba04afb6d7e1 tempest-AttachVolumeTestJSON-430848257 None] Deleting attachment e960e61c-4502-41cf-9846-99c870a42f0a. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Created reservations ['04760026-33fc-4d36-a21b-3904e94fb070'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:40 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:48:40 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:40 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.712s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:40 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:48:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b44d8ba0-2a96-43d8-a63a-dc71a37a391c tempest-GroupsV320Test-85022560 None] Delete group completed successfully. Jun 23 12:48:43 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-aa872fd0-1256-426f-8dab-8c66b6ef396f req-5ba757a6-e84d-432a-9f20-bba8aa0577b7 tempest-AttachVolumeTestJSON-430848257 None] Terminate volume connection completed successfully. Jun 23 12:48:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-aa872fd0-1256-426f-8dab-8c66b6ef396f req-5ba757a6-e84d-432a-9f20-bba8aa0577b7 tempest-AttachVolumeTestJSON-430848257 None] Deleting attachment ce97a80b-c06c-4ee1-bd82-13b82890cd95. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:48:52 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-edc9da4e-bfb6-4fb1-afb2-c25632a99910 req-1536aec9-248b-4368-a751-3f2bca644c57 tempest-TestMinimumBasicScenario-558636926 None] Terminate volume connection completed successfully. Jun 23 12:48:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-edc9da4e-bfb6-4fb1-afb2-c25632a99910 req-1536aec9-248b-4368-a751-3f2bca644c57 tempest-TestMinimumBasicScenario-558636926 None] Deleting attachment 73a1fa64-36fe-498b-b630-3d8e762591ff. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:48:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Acquiring lock "cinder-255117b1-225e-4128-9eaa-94064dc6510c-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Lock "cinder-255117b1-225e-4128-9eaa-94064dc6510c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Acquiring lock "cinder-quobyte-255117b1-225e-4128-9eaa-94064dc6510c" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Lock "cinder-quobyte-255117b1-225e-4128-9eaa-94064dc6510c" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c99685-ba1f-482e-aa25-7ee8d1c571b1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:54 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c Jun 23 12:48:54 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:55 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c" returned: 0 in 1.152s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:55 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c Jun 23 12:48:55 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:56 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-255117b1-225e-4128-9eaa-94064dc6510c" returned: 0 in 1.021s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Lock "cinder-quobyte-255117b1-225e-4128-9eaa-94064dc6510c" released by "delete_volume" :: held 2.235s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Created reservations ['7304336a-8ad5-4df8-bded-e03790739fb5', 'b44e8cdf-9966-4b68-9ea9-bcb6de919b69', '1c6e6a96-99d3-41dd-a831-1b15c9fba0f3', '8a3b6497-9f17-4ace-92a4-359f2fa14342'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:57 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:48:57 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:57 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.783s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:57 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:48:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Deleted volume successfully. Jun 23 12:48:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d0894933-a81e-4161-acf0-bb6dd1707d93 tempest-TestMinimumBasicScenario-558636926 None] Lock "cinder-255117b1-225e-4128-9eaa-94064dc6510c-delete_volume" released by "delete_volume" :: held 3.356s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:48:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "cinder-59fd5da1-6617-4672-aa9b-ab42be7f88a8-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-59fd5da1-6617-4672-aa9b-ab42be7f88a8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "cinder-quobyte-59fd5da1-6617-4672-aa9b-ab42be7f88a8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:48:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-quobyte-59fd5da1-6617-4672-aa9b-ab42be7f88a8" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:48:58 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fc016b-5ffc-47ea-b14a-07bae3686f0c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:48:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:58 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 Jun 23 12:48:58 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:48:59 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Jun 23 12:48:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8" returned: 0 in 1.220s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:48:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:48:59 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8 Jun 23 12:48:59 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:00 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59fd5da1-6617-4672-aa9b-ab42be7f88a8" returned: 0 in 0.872s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-quobyte-59fd5da1-6617-4672-aa9b-ab42be7f88a8" released by "delete_volume" :: held 2.157s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Created reservations ['03ce9887-25cc-4275-8daf-a547f4cb613e', '5016dae7-264b-4c6d-b237-1b28a940c137', '7d734e01-685a-4f1a-a895-0d1db0073f41', '35a2cc6c-ae31-4c30-b75d-10afefb55c07'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:00 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:00 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:01 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.978s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Deleted volume successfully. Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "cinder-2b4fc120-5a79-4aa9-961a-911a74d11d65-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3037eaef-9d12-4042-a1b0-1ed77425af56 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-59fd5da1-6617-4672-aa9b-ab42be7f88a8-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-2b4fc120-5a79-4aa9-961a-911a74d11d65-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "cinder-quobyte-2b4fc120-5a79-4aa9-961a-911a74d11d65" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-quobyte-2b4fc120-5a79-4aa9-961a-911a74d11d65" acquired by "delete_volume" :: waited 0.032s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6496e7d-71d8-4195-b653-d14901f7a6ad]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:02 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 Jun 23 12:49:02 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:03 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65" returned: 0 in 1.102s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:03 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65 Jun 23 12:49:03 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:03 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-2b4fc120-5a79-4aa9-961a-911a74d11d65" returned: 0 in 0.750s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-quobyte-2b4fc120-5a79-4aa9-961a-911a74d11d65" released by "delete_volume" :: held 1.928s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:03 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Created reservations ['a855b257-b86e-4294-8aea-0782f67f6399', 'ed20d61a-56f6-46d3-b76b-2da0c00b37fe', 'fd33572e-5b2d-443b-9a52-c8ad9cdffa20', 'aea5f3a7-2b9b-4cfc-b6d4-6765ac234edb'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:04 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:04 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "cinder-202fd4b2-b619-4d9a-83c3-e383549db45f-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-202fd4b2-b619-4d9a-83c3-e383549db45f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "cinder-quobyte-202fd4b2-b619-4d9a-83c3-e383549db45f" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-quobyte-202fd4b2-b619-4d9a-83c3-e383549db45f" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44be23a-9e27-4e1a-9d0f-8759f914b8f3]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:04 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f Jun 23 12:49:04 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:04 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.806s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:04 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Deleted volume successfully. Jun 23 12:49:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05f639c1-2c5f-4265-9e5e-158a1369b6cf tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-2b4fc120-5a79-4aa9-961a-911a74d11d65-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:05 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f" returned: 0 in 0.889s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:05 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f Jun 23 12:49:05 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:06 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-202fd4b2-b619-4d9a-83c3-e383549db45f" returned: 0 in 0.774s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-quobyte-202fd4b2-b619-4d9a-83c3-e383549db45f" released by "delete_volume" :: held 1.725s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Created reservations ['addea73d-8793-46e1-87cf-b76cc0c79980', '31376e56-b8cf-470e-ab0a-e7c897d45a8d', '1e302ee9-3c28-4b09-aef6-21ac57cca215', 'cef7308b-06f1-4df3-9004-dd24b495d740'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:06 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:06 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:07 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.882s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:07 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Deleted volume successfully. Jun 23 12:49:07 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=82,cinder:INSERT=20,cinder:UPDATE=86,cinder:DELETE=5 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:49:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f132ed23-a920-4dff-8c02-14c6e793c7e9 tempest-AttachVolumeTestJSON-430848257 None] Lock "cinder-202fd4b2-b619-4d9a-83c3-e383549db45f-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=84,cinder:UPDATE=82,cinder:DELETE=5,cinder:INSERT=20 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Flow 'volume_create_manager' (94298535-66fd-44d3-8bc0-7d7f12adafae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b6dd0e-f3a1-47d6-971b-d53b849fcfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b6dd0e-f3a1-47d6-971b-d53b849fcfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1683345029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6391dd-78c5-45bf-b188-fc6bc498aa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef66645940a45c8ad9b77afa9cbfa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:14Z,use_quota=True,user_id='03c7083c5a5d4963b414125aeddf7c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57af0603-8125-4d0f-952e-529b7d06c8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57af0603-8125-4d0f-952e-529b7d06c8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e1bf98-be33-45f8-a821-f1106acf1dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e1bf98-be33-45f8-a821-f1106acf1dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6391dd-78c5-45bf-b188-fc6bc498aa2d', 'volume_name': 'volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92152c36-bd8a-4764-a9a7-fc11dda79181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92152c36-bd8a-4764-a9a7-fc11dda79181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d8b57f-636a-46c5-adb7-55c8c6585278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:14 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Volume fc6391dd-78c5-45bf-b188-fc6bc498aa2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d', 'volume_size': 1} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1683345029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6391dd-78c5-45bf-b188-fc6bc498aa2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef66645940a45c8ad9b77afa9cbfa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:14Z,use_quota=True,user_id='03c7083c5a5d4963b414125aeddf7c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Creating volume fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:14 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:14 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d 1073741824 Jun 23 12:49:14 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:15 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d 1073741824" returned: 0 in 1.253s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:15 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d Jun 23 12:49:15 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:16 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" returned: 0 in 0.828s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] <== create_volume: return (2129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d8b57f-636a-46c5-adb7-55c8c6585278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdda526-5e1e-43b6-b106-d1068ebba8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:16 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Volume volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d (fc6391dd-78c5-45bf-b188-fc6bc498aa2d): created successfully Jun 23 12:49:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdda526-5e1e-43b6-b106-d1068ebba8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:16 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Flow 'volume_create_manager' (94298535-66fd-44d3-8bc0-7d7f12adafae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:16 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c015dc3e-c713-451b-9d58-eaf88be896b2 tempest-VolumesDeleteCascade-1660671785 None] Created volume successfully. Jun 23 12:49:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Creating offline snapshot ad135df1-a87e-4a0d-8c56-fab32d59a3c6 of volume fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:49:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d002f69-33cb-4ecd-bf95-3299245e9ac1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:17 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d Jun 23 12:49:17 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:18 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" returned: 0 in 1.040s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:18 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 1G Jun 23 12:49:18 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Flow 'volume_create_manager' (b08b7507-f6ca-4512-b1f6-3b3f755c124b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3ffb46-7853-4402-b4c5-5fcafa1f56e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3ffb46-7853-4402-b4c5-5fcafa1f56e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-368115084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991a587a-fb9f-4957-ae08-1b5db14f0bea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1b8355c3e8249bba29d60f53002d470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:19Z,use_quota=True,user_id='a1abcaa200bc41d8bc007ecda21927b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e16a0a-df8c-4a07-9b92-1220b3bf8311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5e16a0a-df8c-4a07-9b92-1220b3bf8311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a91af21-d971-47bf-b111-a19aac7c39e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a91af21-d971-47bf-b111-a19aac7c39e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '991a587a-fb9f-4957-ae08-1b5db14f0bea', 'volume_name': 'volume-991a587a-fb9f-4957-ae08-1b5db14f0bea', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee532e0-3165-4458-aaef-6bac433aace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee532e0-3165-4458-aaef-6bac433aace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37e0071-37b2-4031-a526-debec661964a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:19 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Volume 991a587a-fb9f-4957-ae08-1b5db14f0bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-991a587a-fb9f-4957-ae08-1b5db14f0bea', 'volume_size': 1} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:19 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 1G" returned: 0 in 0.902s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:19 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 Jun 23 12:49:19 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:20 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6" returned: 0 in 0.689s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:20 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 is being set with open permissions: ugo+rw Jun 23 12:49:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:20 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 Jun 23 12:49:20 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:21 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6" returned: 0 in 0.898s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:21 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.info Jun 23 12:49:21 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:21 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.info" returned: 0 in 0.671s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:21 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.info is being set with open permissions: ugo+rw Jun 23 12:49:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:21 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.info Jun 23 12:49:21 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:22 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:22 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:22 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.info" returned: 0 in 0.678s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.022s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.238s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-368115084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=991a587a-fb9f-4957-ae08-1b5db14f0bea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1b8355c3e8249bba29d60f53002d470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:19Z,use_quota=True,user_id='a1abcaa200bc41d8bc007ecda21927b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Creating volume 991a587a-fb9f-4957-ae08-1b5db14f0bea {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:22 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:22 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea 1073741824 Jun 23 12:49:22 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:22 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-74eea795-00cc-4778-abdc-9d9702db3da5 tempest-VolumesDeleteCascade-1660671785 None] Create snapshot completed successfully Jun 23 12:49:22 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.754s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:49:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:49:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:49:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:23 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea 1073741824" returned: 0 in 1.067s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:23 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea Jun 23 12:49:23 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (89caf66f-d92b-446d-b03d-f54a5059d7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491c73de-2fee-46ec-98bc-8ce644abbccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (491c73de-2fee-46ec-98bc-8ce644abbccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244613645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51a8d8e-d564-4d5a-95e8-88459755ab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:24Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9747c47e-5772-4e0a-96bb-18adab455d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9747c47e-5772-4e0a-96bb-18adab455d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e35a16-9005-45d2-9e9c-03ae6b1d5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e35a16-9005-45d2-9e9c-03ae6b1d5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a51a8d8e-d564-4d5a-95e8-88459755ab59', 'volume_name': 'volume-a51a8d8e-d564-4d5a-95e8-88459755ab59', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d069f07e-f747-4e6b-83c4-1518ac746ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d069f07e-f747-4e6b-83c4-1518ac746ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb87eed-6c5d-439a-803a-b029e14d598e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Volume a51a8d8e-d564-4d5a-95e8-88459755ab59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a51a8d8e-d564-4d5a-95e8-88459755ab59', 'volume_size': 1} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:24 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea" returned: 0 in 0.676s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.238s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a37e0071-37b2-4031-a526-debec661964a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-991a587a-fb9f-4957-ae08-1b5db14f0bea', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7969a994-0099-40f6-a383-f1d3b6494f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Creating offline snapshot 03f0fa40-7047-4bc0-881e-e503f39be2c3 of volume fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:49:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Volume volume-991a587a-fb9f-4957-ae08-1b5db14f0bea (991a587a-fb9f-4957-ae08-1b5db14f0bea): created successfully Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7969a994-0099-40f6-a383-f1d3b6494f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Flow 'volume_create_manager' (b08b7507-f6ca-4512-b1f6-3b3f755c124b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6e7b25-8214-4d06-8352-b96cf5218807]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a1f11124-88a3-4304-946a-7b512ccf49ff tempest-VolumesTestJSON-1681632834 None] Created volume successfully. Jun 23 12:49:24 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 Jun 23 12:49:24 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:25 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6" returned: 0 in 0.748s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:49:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:25 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 1G Jun 23 12:49:25 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:26 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 1G" returned: 0 in 0.921s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:26 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 Jun 23 12:49:26 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Flow 'volume_create_manager' (94bc2183-7671-4329-bafa-7b94a658f807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1a0e19-e32b-4ce4-ba19-42bcf84ac4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1a0e19-e32b-4ce4-ba19-42bcf84ac4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2011019210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba572fd-4130-4c97-a20a-4db3beca1144,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1b8355c3e8249bba29d60f53002d470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:26Z,use_quota=True,user_id='a1abcaa200bc41d8bc007ecda21927b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61574a2-227b-427e-90c7-74b494c7d5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e61574a2-227b-427e-90c7-74b494c7d5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbc7722-ebd4-464d-8505-a9ed73b8bbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdbc7722-ebd4-464d-8505-a9ed73b8bbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba572fd-4130-4c97-a20a-4db3beca1144', 'volume_name': 'volume-3ba572fd-4130-4c97-a20a-4db3beca1144', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fc131e-acb6-4e85-9631-ca852ef97bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9fc131e-acb6-4e85-9631-ca852ef97bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e245aa8-8872-4229-9ed8-05c4293f7374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Volume 3ba572fd-4130-4c97-a20a-4db3beca1144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba572fd-4130-4c97-a20a-4db3beca1144', 'volume_size': 1} Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:26 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3" returned: 0 in 0.745s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:26 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 is being set with open permissions: ugo+rw Jun 23 12:49:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:27 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 Jun 23 12:49:27 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:27 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3" returned: 0 in 0.801s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.364s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.449s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1244613645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a51a8d8e-d564-4d5a-95e8-88459755ab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:24Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Creating volume a51a8d8e-d564-4d5a-95e8-88459755ab59 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:27 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:27 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 1073741824 Jun 23 12:49:27 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-279571d4-cf27-433f-ba7e-f5656ba6f369 tempest-VolumesDeleteCascade-1660671785 None] Create snapshot completed successfully Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-fc6391dd-78c5-45bf-b188-fc6bc498aa2d-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-fc6391dd-78c5-45bf-b188-fc6bc498aa2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Performing cascade delete. {{(pid=93659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-03f0fa40-7047-4bc0-881e-e503f39be2c3-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-03f0fa40-7047-4bc0-881e-e503f39be2c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-03f0fa40-7047-4bc0-881e-e503f39be2c3" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-03f0fa40-7047-4bc0-881e-e503f39be2c3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Deleting offline snapshot 03f0fa40-7047-4bc0-881e-e503f39be2c3 of volume fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] snapshot_file for this snap is: volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[293c1b11-bf0f-4955-b509-d3ffe6d8522a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:28 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 1073741824" returned: 0 in 1.014s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:28 devstack sudo[105033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 Jun 23 12:49:28 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:28 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 Jun 23 12:49:28 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:29 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3" returned: 0 in 0.900s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b12372-4dae-44a8-9dc6-1a46af857fb4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:29 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59" returned: 0 in 0.806s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.269s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2011019210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba572fd-4130-4c97-a20a-4db3beca1144,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1b8355c3e8249bba29d60f53002d470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:26Z,use_quota=True,user_id='a1abcaa200bc41d8bc007ecda21927b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Creating volume 3ba572fd-4130-4c97-a20a-4db3beca1144 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:29 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb87eed-6c5d-439a-803a-b029e14d598e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a51a8d8e-d564-4d5a-95e8-88459755ab59', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:29 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 1073741824 Jun 23 12:49:29 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb9be2e-63a7-421a-a3fe-0523287e0a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:29 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Volume volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 (a51a8d8e-d564-4d5a-95e8-88459755ab59): created successfully Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb9be2e-63a7-421a-a3fe-0523287e0a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (89caf66f-d92b-446d-b03d-f54a5059d7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:29 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 Jun 23 12:49:29 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7680ae23-18d8-47f5-87bb-ffe35b650450 tempest-VolumesActionsTest-878581220 None] Created volume successfully. Jun 23 12:49:30 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6" returned: 0 in 0.840s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:30 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 Jun 23 12:49:30 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:30 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 1073741824" returned: 0 in 0.987s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-967facc7-b9bd-4f8d-96e6-d6cf7d1aeadb tempest-VolumesActionsTest-878581220 None] Acquiring lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59" by "attach_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-967facc7-b9bd-4f8d-96e6-d6cf7d1aeadb tempest-VolumesActionsTest-878581220 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59" acquired by "attach_volume" :: waited 0.043s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:30 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 Jun 23 12:49:30 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-967facc7-b9bd-4f8d-96e6-d6cf7d1aeadb tempest-VolumesActionsTest-878581220 None] Attaching volume a51a8d8e-d564-4d5a-95e8-88459755ab59 to instance f40ed3b3-efe3-4dbb-8827-7ea8ec1c697c at mountpoint /dev/vdb on host None. Jun 23 12:49:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-967facc7-b9bd-4f8d-96e6-d6cf7d1aeadb tempest-VolumesActionsTest-878581220 None] Attach volume completed successfully. Jun 23 12:49:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-967facc7-b9bd-4f8d-96e6-d6cf7d1aeadb tempest-VolumesActionsTest-878581220 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59" released by "attach_volume" :: held 0.143s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:31 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3" returned: 0 in 0.856s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:31 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3 Jun 23 12:49:31 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:31 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144" returned: 0 in 0.789s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e245aa8-8872-4229-9ed8-05c4293f7374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba572fd-4130-4c97-a20a-4db3beca1144', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ea8d7-8baf-4f8d-be23-b8b3949ceb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:31 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Volume volume-3ba572fd-4130-4c97-a20a-4db3beca1144 (3ba572fd-4130-4c97-a20a-4db3beca1144): created successfully Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6ea8d7-8baf-4f8d-be23-b8b3949ceb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Flow 'volume_create_manager' (94bc2183-7671-4329-bafa-7b94a658f807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-cb0c151a-f9a8-4ef0-90b0-1ca16e283be1 tempest-VolumesTestJSON-1681632834 None] Created volume successfully. Jun 23 12:49:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-eb7fe64a-f377-4366-9976-5bf5950f02d1 tempest-VolumesActionsTest-258801791 None] Terminate volume connection completed successfully. Jun 23 12:49:32 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.03f0fa40-7047-4bc0-881e-e503f39be2c3" returned: 0 in 0.775s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-03f0fa40-7047-4bc0-881e-e503f39be2c3" released by "_delete_snapshot" :: held 3.474s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" released by "delete_snapshot" :: held 3.495s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Created reservations ['d5b38573-3d5d-4c70-92f9-5849d6e89946', '5b4b0fe1-bd0f-4589-9adb-2fa4c85e8d12', 'b3f3ee7f-9d95-4828-9522-db23a97a7f34', '779baaad-53c6-4290-911d-bc7e95087055'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Delete snapshot completed successfully. Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-03f0fa40-7047-4bc0-881e-e503f39be2c3-delete_snapshot" released by "delete_snapshot" :: held 3.641s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-ad135df1-a87e-4a0d-8c56-fab32d59a3c6-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-ad135df1-a87e-4a0d-8c56-fab32d59a3c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-ad135df1-a87e-4a0d-8c56-fab32d59a3c6" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-ad135df1-a87e-4a0d-8c56-fab32d59a3c6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Deleting offline snapshot ad135df1-a87e-4a0d-8c56-fab32d59a3c6 of volume fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] snapshot_file for this snap is: volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb7fe64a-f377-4366-9976-5bf5950f02d1 tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-detach_volume" by "detach_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f967d8-612a-4d8a-9e4c-ff97d0026f2f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb7fe64a-f377-4366-9976-5bf5950f02d1 tempest-VolumesActionsTest-258801791 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-eb7fe64a-f377-4366-9976-5bf5950f02d1 tempest-VolumesActionsTest-258801791 None] Detaching volume a51a8d8e-d564-4d5a-95e8-88459755ab59 from instance f40ed3b3-efe3-4dbb-8827-7ea8ec1c697c. Jun 23 12:49:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-eb7fe64a-f377-4366-9976-5bf5950f02d1 tempest-VolumesActionsTest-258801791 None] Detach volume completed successfully. Jun 23 12:49:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb7fe64a-f377-4366-9976-5bf5950f02d1 tempest-VolumesActionsTest-258801791 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:32 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 Jun 23 12:49:32 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-71cef5ad-cb90-499c-849c-10f5eded5a83 tempest-VolumesActionsTest-878581220 None] Acquiring lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-detach_volume" by "detach_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-71cef5ad-cb90-499c-849c-10f5eded5a83 tempest-VolumesActionsTest-878581220 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:33 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-71cef5ad-cb90-499c-849c-10f5eded5a83 tempest-VolumesActionsTest-878581220 None] Volume detach called, but volume not attached. Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-71cef5ad-cb90-499c-849c-10f5eded5a83 tempest-VolumesActionsTest-878581220 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:33 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6" returned: 0 in 0.892s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[94541ff4-dbff-42e2-acd4-02a79d94d9e6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Flow 'volume_create_manager' (993f5b4e-9b45-4c12-883a-bfb40e6348d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210aa2f5-9b34-4fd5-9e5a-18c95cbe3183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210aa2f5-9b34-4fd5-9e5a-18c95cbe3183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-553170433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77364991-68eb-4499-adb0-5ba4204e186d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1b8355c3e8249bba29d60f53002d470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:33Z,use_quota=True,user_id='a1abcaa200bc41d8bc007ecda21927b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728ab093-a5e7-48b9-ad96-7c3a2d5c109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728ab093-a5e7-48b9-ad96-7c3a2d5c109d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:33 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d Jun 23 12:49:33 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ef1ac5-f8ea-48c3-bcdf-80487950cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ef1ac5-f8ea-48c3-bcdf-80487950cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77364991-68eb-4499-adb0-5ba4204e186d', 'volume_name': 'volume-77364991-68eb-4499-adb0-5ba4204e186d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c3ef0f-c61e-460c-8591-379ece844049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c3ef0f-c61e-460c-8591-379ece844049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cb4c17-58f4-441e-8c61-c0da3f8b2c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:33 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Volume 77364991-68eb-4499-adb0-5ba4204e186d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77364991-68eb-4499-adb0-5ba4204e186d', 'volume_size': 1} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-553170433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77364991-68eb-4499-adb0-5ba4204e186d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d1b8355c3e8249bba29d60f53002d470',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:33Z,use_quota=True,user_id='a1abcaa200bc41d8bc007ecda21927b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Creating volume 77364991-68eb-4499-adb0-5ba4204e186d {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:33 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:33 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d 1073741824 Jun 23 12:49:33 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Acquiring lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Acquiring lock "cinder-quobyte-a51a8d8e-d564-4d5a-95e8-88459755ab59" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Lock "cinder-quobyte-a51a8d8e-d564-4d5a-95e8-88459755ab59" acquired by "delete_volume" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[af63cd6c-3027-4af9-b478-71a2b57690f5]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:34 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" returned: 0 in 0.903s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:34 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 Jun 23 12:49:34 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 Jun 23 12:49:34 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:34 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:34 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d 1073741824" returned: 0 in 1.053s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:34 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d Jun 23 12:49:34 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:34 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59" returned: 0 in 0.858s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:34 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6" returned: 0 in 0.770s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:35 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59 Jun 23 12:49:35 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:35 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6 Jun 23 12:49:35 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:35 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d" returned: 0 in 0.685s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cb4c17-58f4-441e-8c61-c0da3f8b2c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77364991-68eb-4499-adb0-5ba4204e186d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7347c078-75b5-41ed-85b1-64b0deadec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:35 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Volume volume-77364991-68eb-4499-adb0-5ba4204e186d (77364991-68eb-4499-adb0-5ba4204e186d): created successfully Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7347c078-75b5-41ed-85b1-64b0deadec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Flow 'volume_create_manager' (993f5b4e-9b45-4c12-883a-bfb40e6348d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-fe13b682-7d27-493b-b5a7-48ce4dd11211 tempest-VolumesTestJSON-1681632834 None] Created volume successfully. Jun 23 12:49:35 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d.ad135df1-a87e-4a0d-8c56-fab32d59a3c6" returned: 0 in 0.650s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:35 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a51a8d8e-d564-4d5a-95e8-88459755ab59" returned: 0 in 0.707s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-ad135df1-a87e-4a0d-8c56-fab32d59a3c6" released by "_delete_snapshot" :: held 3.342s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Lock "cinder-quobyte-a51a8d8e-d564-4d5a-95e8-88459755ab59" released by "delete_volume" :: held 1.616s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" released by "delete_snapshot" :: held 3.371s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Created reservations ['bed21ae9-39cb-44cb-a571-908a00fa038f', '3c2bccba-464e-4125-94b5-fdf8c2a947fd', '606bd131-5c16-46fe-aff4-c8de1d2c627c', '66f05692-73d3-46ba-a264-3500c9bc2d63'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Created reservations ['94ae7720-169b-4dc8-b6dd-c0f889523793', '1aa573f4-4baf-4ac8-bc06-06ff420198d5', '86889878-b0ca-48fb-9d05-3d6d6528328a', '3d6e94da-f571-48bd-8dc5-1429eea44e1c'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:35 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:35 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Delete snapshot completed successfully. Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-ad135df1-a87e-4a0d-8c56-fab32d59a3c6-delete_snapshot" released by "delete_snapshot" :: held 3.615s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Snapshots deleted, issuing volume delete {{(pid=93659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d30ab6f-c5b4-4eed-a3bc-2b0c7081c088]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:36 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d Jun 23 12:49:36 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Acquiring lock "cinder-77364991-68eb-4499-adb0-5ba4204e186d-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Lock "cinder-77364991-68eb-4499-adb0-5ba4204e186d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Acquiring lock "cinder-quobyte-77364991-68eb-4499-adb0-5ba4204e186d" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Lock "cinder-quobyte-77364991-68eb-4499-adb0-5ba4204e186d" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:36 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.792s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Deleted volume successfully. Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[38341c96-4968-4d30-a7a1-c71257295551]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7112f39-51bd-445d-8ed8-07a4a12ace7d tempest-VolumesActionsTest-878581220 None] Lock "cinder-a51a8d8e-d564-4d5a-95e8-88459755ab59-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:36 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d Jun 23 12:49:36 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:36 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" returned: 0 in 0.920s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:36 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d Jun 23 12:49:36 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:37 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d" returned: 0 in 0.817s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:37 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d Jun 23 12:49:37 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:37 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" returned: 0 in 0.778s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-fc6391dd-78c5-45bf-b188-fc6bc498aa2d" released by "delete_volume" :: held 1.777s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Created reservations ['d7f07ac6-4b29-4dde-8e26-d771a9e63c8e', '3c20cabc-009d-44a9-818d-c2c91c29eb12', 'a9051664-da69-4e64-8732-b7be07280d58', 'faf70ecc-fe8a-45d4-a088-bbd4d3cbfe7e'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:37 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:37 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:38 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-77364991-68eb-4499-adb0-5ba4204e186d" returned: 0 in 0.846s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Lock "cinder-quobyte-77364991-68eb-4499-adb0-5ba4204e186d" released by "delete_volume" :: held 1.719s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Created reservations ['aa5bea4a-54db-4d26-a365-b9aea9befaf5', 'fb330b5a-15e7-4ff1-b5fb-c439904375d0', 'a860b581-7cb0-4abc-a8d1-e91687c58dd7', '91a66321-0676-4db5-aec8-7171624327c5'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:38 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:38 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:38 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.821s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Deleted volume successfully. Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ccfa0538-2b83-4eed-a2e2-6a7051d68222 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-fc6391dd-78c5-45bf-b188-fc6bc498aa2d-delete_volume" released by "delete_volume" :: held 10.240s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Acquiring lock "cinder-3ba572fd-4130-4c97-a20a-4db3beca1144-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Lock "cinder-3ba572fd-4130-4c97-a20a-4db3beca1144-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Acquiring lock "cinder-quobyte-3ba572fd-4130-4c97-a20a-4db3beca1144" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Lock "cinder-quobyte-3ba572fd-4130-4c97-a20a-4db3beca1144" acquired by "delete_volume" :: waited 0.031s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a82c0f-cc0a-460b-ae72-702f35b394c2]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:39 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 Jun 23 12:49:39 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Flow 'volume_create_manager' (7681696b-6717-41d1-9038-66667cbc536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d5667b-487f-46ab-98fd-f177a3a7345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d5667b-487f-46ab-98fd-f177a3a7345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1394262969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d93c79b-66b9-4871-85b7-b9113e895fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef66645940a45c8ad9b77afa9cbfa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:39Z,use_quota=True,user_id='03c7083c5a5d4963b414125aeddf7c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99aa72c-7ec0-4ac0-943c-753d978f1851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f99aa72c-7ec0-4ac0-943c-753d978f1851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0820866c-0565-4fd7-a761-066d97928c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0820866c-0565-4fd7-a761-066d97928c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d93c79b-66b9-4871-85b7-b9113e895fbd', 'volume_name': 'volume-6d93c79b-66b9-4871-85b7-b9113e895fbd', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b9bd9a-3c2b-4c04-9877-a90aaac7a64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b9bd9a-3c2b-4c04-9877-a90aaac7a64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5a3762-5adc-4e0f-b9fc-8c40bcb00b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:39 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Volume 6d93c79b-66b9-4871-85b7-b9113e895fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d93c79b-66b9-4871-85b7-b9113e895fbd', 'volume_size': 1} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1394262969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d93c79b-66b9-4871-85b7-b9113e895fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef66645940a45c8ad9b77afa9cbfa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:39Z,use_quota=True,user_id='03c7083c5a5d4963b414125aeddf7c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Creating volume 6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:39 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:39 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.784s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:39 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd 1073741824 Jun 23 12:49:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Deleted volume successfully. Jun 23 12:49:39 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eede1d32-809a-40b9-b400-5370a0299afa tempest-VolumesTestJSON-1681632834 None] Lock "cinder-77364991-68eb-4499-adb0-5ba4204e186d-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:39 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144" returned: 0 in 0.895s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:39 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144 Jun 23 12:49:39 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:40 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd 1073741824" returned: 0 in 0.958s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:40 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd Jun 23 12:49:40 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:40 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ba572fd-4130-4c97-a20a-4db3beca1144" returned: 0 in 0.695s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Lock "cinder-quobyte-3ba572fd-4130-4c97-a20a-4db3beca1144" released by "delete_volume" :: held 1.652s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Created reservations ['502eebe9-13df-4d44-92e0-16aade5755a6', '7837c66a-58e4-4962-acf7-ce187dfcfe56', '72440a66-72ea-414c-9746-28cb272793d7', '11dad192-f9e4-437f-92b0-a696bdab1efc'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:40 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:40 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:40 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd" returned: 0 in 0.646s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd5a3762-5adc-4e0f-b9fc-8c40bcb00b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d93c79b-66b9-4871-85b7-b9113e895fbd', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88295c9c-0a62-4185-b9e5-09e0f80f116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:40 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Volume volume-6d93c79b-66b9-4871-85b7-b9113e895fbd (6d93c79b-66b9-4871-85b7-b9113e895fbd): created successfully Jun 23 12:49:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88295c9c-0a62-4185-b9e5-09e0f80f116e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Flow 'volume_create_manager' (7681696b-6717-41d1-9038-66667cbc536e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:41 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-fe2123ce-d85e-4bbd-9f50-7103dfa0af08 tempest-VolumesDeleteCascade-1660671785 None] Created volume successfully. Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Acquiring lock "cinder-991a587a-fb9f-4957-ae08-1b5db14f0bea-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Lock "cinder-991a587a-fb9f-4957-ae08-1b5db14f0bea-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Acquiring lock "cinder-quobyte-991a587a-fb9f-4957-ae08-1b5db14f0bea" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Lock "cinder-quobyte-991a587a-fb9f-4957-ae08-1b5db14f0bea" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12368d9c-3d59-4fe5-b100-9a182a9c566e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:41 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea Jun 23 12:49:41 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:41 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Creating offline snapshot 9e46733e-c07f-4620-a2d2-d7ce96db9206 of volume 6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.747s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:41 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Deleted volume successfully. Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54db297-e6d9-45c2-b8b2-758ed8fa4fd0]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f1a3a12-7187-47e1-a98c-b7f4c5491e54 tempest-VolumesTestJSON-1681632834 None] Lock "cinder-3ba572fd-4130-4c97-a20a-4db3beca1144-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:41 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd Jun 23 12:49:41 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:41 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea" returned: 0 in 0.801s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:41 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea Jun 23 12:49:41 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:42 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd" returned: 0 in 0.784s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:42 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 1G Jun 23 12:49:42 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:42 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-991a587a-fb9f-4957-ae08-1b5db14f0bea" returned: 0 in 0.632s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Lock "cinder-quobyte-991a587a-fb9f-4957-ae08-1b5db14f0bea" released by "delete_volume" :: held 1.474s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Created reservations ['64627160-e078-4161-bd34-925e6b6e9803', '347c9252-1ce3-486b-adef-2142538dd2d6', 'c6fcc5ac-1a5c-43e4-8edd-f1678e675648', 'b752db65-cbc4-415d-a879-b7a8d93f3dd9'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:42 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:42 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:43 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 1G" returned: 0 in 0.896s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d93c79b-66b9-4871-85b7-b9113e895fbd -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:43 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d93c79b-66b9-4871-85b7-b9113e895fbd -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 Jun 23 12:49:43 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:43 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.669s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:43 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:43 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Deleted volume successfully. Jun 23 12:49:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ddab9d15-672e-455c-9f41-4d0ecdafe1cb tempest-VolumesTestJSON-1681632834 None] Lock "cinder-991a587a-fb9f-4957-ae08-1b5db14f0bea-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:43 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d93c79b-66b9-4871-85b7-b9113e895fbd -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206" returned: 0 in 0.691s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:43 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 is being set with open permissions: ugo+rw Jun 23 12:49:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:43 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 Jun 23 12:49:43 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:44 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206" returned: 0 in 0.682s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:44 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.info Jun 23 12:49:44 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (6a9373e5-f8fa-420f-8a8f-997cad13c0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027590a8-c179-462f-94c3-cada02e6472c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027590a8-c179-462f-94c3-cada02e6472c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991349672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:45Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff6e24c-0cc6-4b5b-b973-2ea1df684687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff6e24c-0cc6-4b5b-b973-2ea1df684687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491aaf5d-0a0e-4430-a000-29941ce9e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (491aaf5d-0a0e-4430-a000-29941ce9e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c', 'volume_name': 'volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aab2b41-afdf-444a-ab76-6bfb5159dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aab2b41-afdf-444a-ab76-6bfb5159dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db43123-7936-4e7b-bd08-6415ae0fac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:44 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Volume b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c', 'volume_size': 1} Jun 23 12:49:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:45 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.info" returned: 0 in 0.678s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:45 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.info is being set with open permissions: ugo+rw Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:45 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.info Jun 23 12:49:45 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:45 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.info" returned: 0 in 0.654s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.500s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1991349672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:45Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Creating volume b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:45 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:45 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c 1073741824 Jun 23 12:49:45 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6f1cae8f-a0f9-4247-9d8e-f4f765d50868 tempest-VolumesDeleteCascade-1660671785 None] Create snapshot completed successfully Jun 23 12:49:46 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c 1073741824" returned: 0 in 0.860s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:46 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c Jun 23 12:49:46 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Flow 'volume_create_manager' (814342c9-f7e7-4b17-bcfc-b408d5eb5809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74643fb2-4e58-443a-bb4a-9f5c055287c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74643fb2-4e58-443a-bb4a-9f5c055287c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1116102527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc5b190-31aa-4f46-953b-7452ae9e6e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef66645940a45c8ad9b77afa9cbfa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9e46733e-c07f-4620-a2d2-d7ce96db9206,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:47Z,use_quota=True,user_id='03c7083c5a5d4963b414125aeddf7c7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e0c816-ea23-4101-9561-df7ff70900ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e0c816-ea23-4101-9561-df7ff70900ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d4f24b-16af-4301-b116-685c0285a72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d4f24b-16af-4301-b116-685c0285a72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ddc5b190-31aa-4f46-953b-7452ae9e6e4e', 'volume_name': 'volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e', 'volume_size': 1, 'snapshot_id': '9e46733e-c07f-4620-a2d2-d7ce96db9206'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e0c020-331a-4cc1-971f-41250d01090f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e0c020-331a-4cc1-971f-41250d01090f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbf91c5-0445-43cf-86af-723699009931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:47 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Volume ddc5b190-31aa-4f46-953b-7452ae9e6e4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e', 'volume_size': 1, 'snapshot_id': '9e46733e-c07f-4620-a2d2-d7ce96db9206'} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:47 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c" returned: 0 in 0.642s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.199s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-9e46733e-c07f-4620-a2d2-d7ce96db9206-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db43123-7936-4e7b-bd08-6415ae0fac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12e5ff9-d16a-44ec-b76d-64bbe8d38926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-9e46733e-c07f-4620-a2d2-d7ce96db9206-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Creating volume ddc5b190-31aa-4f46-953b-7452ae9e6e4e from snapshot 9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:47 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Volume volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c (b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c): created successfully Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c12e5ff9-d16a-44ec-b76d-64bbe8d38926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (6a9373e5-f8fa-420f-8a8f-997cad13c0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] snapshot: 9e46733e-c07f-4620-a2d2-d7ce96db9206, volume: ddc5b190-31aa-4f46-953b-7452ae9e6e4e, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:49:47 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-df46d72b-3085-4f4c-b8ba-9785e354c39b tempest-VolumesActionsTest-878581220 None] Created volume successfully. Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[655e87b9-8280-4f0a-a41a-02f55d6a55ad]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:47 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 Jun 23 12:49:47 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4949b294-5e06-4396-b2a4-27b63638163e tempest-BackendsCapabilitiesAdminTestsJSON-1495701438 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864738464355, 'free_capacity_gb': 1775.6864738464355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93659) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Lock "cinder-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-quobyte-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[392cc0d5-a812-4ae6-afba-56d90a52879c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:48 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c Jun 23 12:49:48 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f906a15e-5ac4-4fda-8863-28d593cbfab9 tempest-BackendsCapabilitiesAdminTestsJSON-1495701438 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6864738464355, 'free_capacity_gb': 1775.6864738464355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93659) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 12:49:48 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206" returned: 0 in 0.757s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d93c79b-66b9-4871-85b7-b9113e895fbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[45263f8a-41fa-456a-b4ef-c0c3209b16da]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:48 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd Jun 23 12:49:48 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:48 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c" returned: 0 in 0.752s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:48 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c Jun 23 12:49:48 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:49 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd" returned: 0 in 0.774s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:49 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e Jun 23 12:49:49 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:49 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c" returned: 0 in 0.695s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c" released by "delete_volume" :: held 1.493s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Created reservations ['e3c2c42b-e57a-4e1d-9fe5-fd530d2dedc0', 'd7aa1f62-3ce6-4f63-82ec-eb46e8b3b88a', 'ba6a4041-6aa3-449d-bae6-f0a3aaa430da', 'a6fd48a0-05b7-44d3-b834-8a603c12fa21'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:49 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:49 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:50 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.250s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:50 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:49:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Deleted volume successfully. Jun 23 12:49:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bed51829-c861-4f45-a754-11025ba489a9 tempest-VolumesActionsTest-258801791 None] Lock "cinder-b5c4d5b8-37f5-4dfc-9a1f-624b7c7d0f8c-delete_volume" released by "delete_volume" :: held 3.008s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:51 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:49:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (b1585cf1-3354-4bf4-b1fe-81205a632427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd7a280-65a8-40f9-a723-4b0c3ef5ef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd7a280-65a8-40f9-a723-4b0c3ef5ef4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1316994237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e4af6d-980f-4059-aabb-0d4068c1f2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:52Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229c4f00-a107-4e0a-9be6-b6101065e786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (229c4f00-a107-4e0a-9be6-b6101065e786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb6aba8-91e0-4f75-8aae-154f66a518dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb6aba8-91e0-4f75-8aae-154f66a518dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4e4af6d-980f-4059-aabb-0d4068c1f2ad', 'volume_name': 'volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97673177-c780-4e8c-a4f3-4bbaf192c8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97673177-c780-4e8c-a4f3-4bbaf192c8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6672f400-76bd-453d-a6cc-f388dc3c9e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:52 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Volume b4e4af6d-980f-4059-aabb-0d4068c1f2ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad', 'volume_size': 1} Jun 23 12:49:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:54 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" returned: 0 in 5.364s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f13925-010d-40d1-8392-b2a8c812321b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:54 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd Jun 23 12:49:54 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:55 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd" returned: 0 in 0.873s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:55 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd, size 1024.00 MB, duration 5.36 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:49:55 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Converted 1024.00 MB image at 190.87 MB/s Jun 23 12:49:55 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e is being set with open permissions: ugo+rw Jun 23 12:49:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:55 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e Jun 23 12:49:55 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:56 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" returned: 0 in 0.644s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" released by "_copy_volume_from_snapshot" :: held 8.516s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-9e46733e-c07f-4620-a2d2-d7ce96db9206-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" released by "_create_volume_from_snapshot" :: held 8.558s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.588s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.925s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1316994237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4e4af6d-980f-4059-aabb-0d4068c1f2ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:49:52Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Creating volume b4e4af6d-980f-4059-aabb-0d4068c1f2ad {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:49:56 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:56 devstack sudo[105315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad 1073741824 Jun 23 12:49:56 devstack sudo[105315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abbf91c5-0445-43cf-86af-723699009931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e', 'volume_size': 1, 'snapshot_id': '9e46733e-c07f-4620-a2d2-d7ce96db9206'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abf5771-c920-4b94-8146-b46e570115f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Volume volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e (ddc5b190-31aa-4f46-953b-7452ae9e6e4e): created successfully Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abf5771-c920-4b94-8146-b46e570115f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Flow 'volume_create_manager' (814342c9-f7e7-4b17-bcfc-b408d5eb5809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:56 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-70f1043d-b729-4c01-bdf8-c3bd07977b8c tempest-VolumesDeleteCascade-1660671785 None] Created volume successfully. Jun 23 12:49:56 devstack sudo[105315]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad 1073741824" returned: 0 in 0.854s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:56 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad Jun 23 12:49:56 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-6d93c79b-66b9-4871-85b7-b9113e895fbd-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-6d93c79b-66b9-4871-85b7-b9113e895fbd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Performing cascade delete. {{(pid=93659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-9e46733e-c07f-4620-a2d2-d7ce96db9206-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-9e46733e-c07f-4620-a2d2-d7ce96db9206-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-6d93c79b-66b9-4871-85b7-b9113e895fbd" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-6d93c79b-66b9-4871-85b7-b9113e895fbd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-9e46733e-c07f-4620-a2d2-d7ce96db9206" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-9e46733e-c07f-4620-a2d2-d7ce96db9206" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Deleting offline snapshot 9e46733e-c07f-4620-a2d2-d7ce96db9206 of volume 6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] snapshot_file for this snap is: volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8958c8-61de-45d5-a2da-20d1712b8102]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:57 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 Jun 23 12:49:57 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:57 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad" returned: 0 in 0.765s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6672f400-76bd-453d-a6cc-f388dc3c9e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d96980-3bab-43f7-8b5e-378257b57853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:49:57 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Volume volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad (b4e4af6d-980f-4059-aabb-0d4068c1f2ad): created successfully Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15d96980-3bab-43f7-8b5e-378257b57853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:49:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (b1585cf1-3354-4bf4-b1fe-81205a632427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:49:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f861ffce-3bcf-407e-87db-5d3b884688cd tempest-VolumesActionsTest-878581220 None] Created volume successfully. Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-b4e4af6d-980f-4059-aabb-0d4068c1f2ad-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Lock "cinder-b4e4af6d-980f-4059-aabb-0d4068c1f2ad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-quobyte-b4e4af6d-980f-4059-aabb-0d4068c1f2ad" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-b4e4af6d-980f-4059-aabb-0d4068c1f2ad" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c34ccd-05bd-43e7-974a-cc44ef2f35f7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:58 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206" returned: 0 in 0.935s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d93c79b-66b9-4871-85b7-b9113e895fbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc0c5b-e295-4647-896c-844b8b58a701]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:49:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:58 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad Jun 23 12:49:58 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:58 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd Jun 23 12:49:58 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:59 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad" returned: 0 in 0.816s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:59 devstack sudo[105346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad Jun 23 12:49:59 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:59 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd" returned: 0 in 0.809s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:59 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 Jun 23 12:49:59 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:49:59 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b4e4af6d-980f-4059-aabb-0d4068c1f2ad" returned: 0 in 0.735s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-b4e4af6d-980f-4059-aabb-0d4068c1f2ad" released by "delete_volume" :: held 1.592s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Created reservations ['28e77fc5-9011-4159-8d05-228f72c8827a', '7a3cd1d1-3196-49d4-8c7f-9b21aa083505', 'a4dd9d3f-dbec-43fe-a727-5f34d8085f5c', '84c4868d-ab2d-4650-a75e-765ae778bb69'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:49:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:49:59 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:49:59 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:00 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206" returned: 0 in 0.893s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:00 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206 Jun 23 12:50:00 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:00 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.687s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:00 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Deleted volume successfully. Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-85ba3164-eaa9-447a-9713-3b495d98bd93 tempest-VolumesActionsTest-258801791 None] Lock "cinder-b4e4af6d-980f-4059-aabb-0d4068c1f2ad-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:00 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd.9e46733e-c07f-4620-a2d2-d7ce96db9206" returned: 0 in 0.734s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-9e46733e-c07f-4620-a2d2-d7ce96db9206" released by "_delete_snapshot" :: held 3.493s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-6d93c79b-66b9-4871-85b7-b9113e895fbd" released by "delete_snapshot" :: held 3.521s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:00 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Created reservations ['fcfd3675-e988-4dc0-9c15-5e31475b9235', '0e9b90ff-d645-413c-b9bb-4b7598aabb15', 'b27e9332-9935-4b53-967e-e19980993f4a', 'd0453a68-53e7-45c0-87d9-5886ae389531'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Delete snapshot completed successfully. Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-9e46733e-c07f-4620-a2d2-d7ce96db9206-delete_snapshot" released by "delete_snapshot" :: held 3.721s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Snapshots deleted, issuing volume delete {{(pid=93659) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-6d93c79b-66b9-4871-85b7-b9113e895fbd" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-6d93c79b-66b9-4871-85b7-b9113e895fbd" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a7dd96-69bb-40c1-a89c-f01640ec0b5a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (0a4d0a80-2610-437b-a299-f7e090d96258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68dd949-8d5a-4a64-bec7-808f97170c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68dd949-8d5a-4a64-bec7-808f97170c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749903391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0f6bb5-320f-4ab1-b570-1c7f45eda628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:01Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335d4a50-53b2-455b-9356-896f57afd807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335d4a50-53b2-455b-9356-896f57afd807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d9f185-3f72-4751-aaeb-c0c3e8f0b9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d9f185-3f72-4751-aaeb-c0c3e8f0b9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c0f6bb5-320f-4ab1-b570-1c7f45eda628', 'volume_name': 'volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8047f4ff-6b90-4149-a15a-b7f48aa9254e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8047f4ff-6b90-4149-a15a-b7f48aa9254e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d899763-19a3-4d8b-ac7e-5352cf8968d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Volume 5c0f6bb5-320f-4ab1-b570-1c7f45eda628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628', 'volume_size': 1} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749903391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c0f6bb5-320f-4ab1-b570-1c7f45eda628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:01Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Creating volume 5c0f6bb5-320f-4ab1-b570-1c7f45eda628 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:01 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:01 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd Jun 23 12:50:01 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:01 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 1073741824 Jun 23 12:50:01 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:01 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd" returned: 0 in 0.798s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:01 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd Jun 23 12:50:01 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c5c91d32-eda5-4a69-b473-6629eefa25df tempest-GroupsV314Test-249194652 None] Group tempest-GroupsV314Test-Group-1950315113: creating Jun 23 12:50:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c5c91d32-eda5-4a69-b473-6629eefa25df tempest-GroupsV314Test-249194652 None] Group tempest-GroupsV314Test-Group-1950315113: created successfully Jun 23 12:50:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c5c91d32-eda5-4a69-b473-6629eefa25df tempest-GroupsV314Test-249194652 None] Create group completed successfully. Jun 23 12:50:02 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 1073741824" returned: 0 in 0.988s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:02 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 Jun 23 12:50:02 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:02 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d93c79b-66b9-4871-85b7-b9113e895fbd" returned: 0 in 0.699s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-6d93c79b-66b9-4871-85b7-b9113e895fbd" released by "delete_volume" :: held 1.581s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Created reservations ['063ff45d-2b24-448a-ad5b-6bc344e5421e', '4ded0324-fb57-4ff1-9a7b-416a611683e7', '262af9da-6703-4681-8abf-d6e8a47dc9e6', 'e8213770-75e8-4750-a7d0-fcecea4e278a'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:02 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:02 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:02 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628" returned: 0 in 0.744s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d899763-19a3-4d8b-ac7e-5352cf8968d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ce4330-d3c4-4333-ad80-2b5cf9111f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Volume volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 (5c0f6bb5-320f-4ab1-b570-1c7f45eda628): created successfully Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ce4330-d3c4-4333-ad80-2b5cf9111f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (0a4d0a80-2610-437b-a299-f7e090d96258) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-eb0c7b16-3ae8-4917-9b85-525ba5aed651 tempest-VolumesActionsTest-878581220 None] Created volume successfully. Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-5c0f6bb5-320f-4ab1-b570-1c7f45eda628-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Lock "cinder-5c0f6bb5-320f-4ab1-b570-1c7f45eda628-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:03 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.661s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Deleted volume successfully. Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-quobyte-5c0f6bb5-320f-4ab1-b570-1c7f45eda628" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2cd468a8-7d1e-4dfe-8549-b18f1d6dde27 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-6d93c79b-66b9-4871-85b7-b9113e895fbd-delete_volume" released by "delete_volume" :: held 6.238s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-5c0f6bb5-320f-4ab1-b570-1c7f45eda628" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a482d2-baaf-45e3-8a3f-2f1b1728da75]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:03 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 Jun 23 12:50:03 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Flow 'volume_create_manager' (05b4ae16-5b12-47eb-9d4e-3ce32cb238d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936d0d9a-66e1-4aa3-9f40-dcecb8592427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936d0d9a-66e1-4aa3-9f40-dcecb8592427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-772035018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91a3daec-ad3f-41f8-9761-76bb5e3b4539,host='devstack@QuobyteHD#QuobyteHD',id=6ceee843-107b-406e-b22a-207e75966713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838f0b2a70f345b3a1c7473a3300d00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:04Z,use_quota=True,user_id='a4dc71f1f99a4fdca5a80895d42ecc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cc7d813-d3b2-4cdb-b81c-3130e25aa156),volume_type_id=9cc7d813-d3b2-4cdb-b81c-3130e25aa156)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcf11ef-031e-4b47-9e51-e0dbf76e0607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcf11ef-031e-4b47-9e51-e0dbf76e0607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073200af-b350-4ca9-87a4-bb750b833fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073200af-b350-4ca9-87a4-bb750b833fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ceee843-107b-406e-b22a-207e75966713', 'volume_name': 'volume-6ceee843-107b-406e-b22a-207e75966713', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba24d13a-acc3-43fc-810b-317b65bd83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba24d13a-acc3-43fc-810b-317b65bd83ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2a8a8c-2ce9-4f14-bf5a-d91095f484bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Volume 6ceee843-107b-406e-b22a-207e75966713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ceee843-107b-406e-b22a-207e75966713', 'volume_size': 1} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=91a3daec-ad3f-41f8-9761-76bb5e3b4539,created_at=2026-06-23T10:50:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-772035018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=91a3daec-ad3f-41f8-9761-76bb5e3b4539,host='devstack@QuobyteHD#QuobyteHD',id=6ceee843-107b-406e-b22a-207e75966713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='838f0b2a70f345b3a1c7473a3300d00f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:04Z,use_quota=True,user_id='a4dc71f1f99a4fdca5a80895d42ecc5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cc7d813-d3b2-4cdb-b81c-3130e25aa156),volume_type_id=9cc7d813-d3b2-4cdb-b81c-3130e25aa156)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Creating volume 6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:03 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-ddc5b190-31aa-4f46-953b-7452ae9e6e4e-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:03 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 1073741824 Jun 23 12:50:03 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-ddc5b190-31aa-4f46-953b-7452ae9e6e4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "cinder-quobyte-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe841a3-c761-406b-ad12-c09179869840]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:04 devstack sudo[105385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e Jun 23 12:50:04 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:04 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628" returned: 0 in 0.843s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:04 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628 Jun 23 12:50:04 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:04 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 1073741824" returned: 0 in 0.858s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:04 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" returned: 0 in 0.793s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:04 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 Jun 23 12:50:04 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:04 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e Jun 23 12:50:04 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:05 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5c0f6bb5-320f-4ab1-b570-1c7f45eda628" returned: 0 in 0.683s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-5c0f6bb5-320f-4ab1-b570-1c7f45eda628" released by "delete_volume" :: held 1.577s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Created reservations ['bf0fc3a5-7240-4237-9249-18cb6b6e093a', 'bf3aba5f-90b0-4134-8335-bfc1c274a5ac', '61ed1cae-8ff5-4096-9c93-93de644b93a7', 'cdf433da-e571-491f-a5ed-1f3c4b35b040'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:05 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:05 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:05 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:05 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713" returned: 0 in 0.709s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" returned: 0 in 0.712s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb2a8a8c-2ce9-4f14-bf5a-d91095f484bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ceee843-107b-406e-b22a-207e75966713', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf03f48-b54c-43d0-8b11-619a64c0c5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-quobyte-ddc5b190-31aa-4f46-953b-7452ae9e6e4e" released by "delete_volume" :: held 1.574s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:05 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Volume volume-6ceee843-107b-406e-b22a-207e75966713 (6ceee843-107b-406e-b22a-207e75966713): created successfully Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf03f48-b54c-43d0-8b11-619a64c0c5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Flow 'volume_create_manager' (05b4ae16-5b12-47eb-9d4e-3ce32cb238d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-93233345-a4a5-4658-9395-e7730e56d58e tempest-GroupsV314Test-249194652 None] Created volume successfully. Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Created reservations ['e01bc99a-55e9-41fe-adac-88968f15be3a', '4fd64259-ec7e-43c9-91f0-94e6a1379f12', 'b9c8f59e-4d6d-49dc-a549-d76ea53667f9', 'fa1f69ca-caf3-4ee1-a321-0afce76b6b7d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:05 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:05 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:05 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.669s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Deleted volume successfully. Jun 23 12:50:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bc6a429e-1da7-4589-ad29-8e2e38a76fce tempest-VolumesActionsTest-258801791 None] Lock "cinder-5c0f6bb5-320f-4ab1-b570-1c7f45eda628-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (a33503df-1e97-4a19-a164-e3bf73dc3d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb48fe13-6f2a-4289-8fb3-682b2796279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb48fe13-6f2a-4289-8fb3-682b2796279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-688480209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b569fa-f291-4e48-863f-e9879c6d519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:06Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0955d52d-55f4-4f44-b1d4-fbba36d26964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0955d52d-55f4-4f44-b1d4-fbba36d26964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13934e9c-97a8-4cc7-a988-ef0df3353e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13934e9c-97a8-4cc7-a988-ef0df3353e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b569fa-f291-4e48-863f-e9879c6d519f', 'volume_name': 'volume-20b569fa-f291-4e48-863f-e9879c6d519f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7ce748-c8c7-4ac5-8eb7-0a55db9db883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a7ce748-c8c7-4ac5-8eb7-0a55db9db883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc931c7-3706-4bf2-8a30-e7044bddf33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:06 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Volume 20b569fa-f291-4e48-863f-e9879c6d519f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b569fa-f291-4e48-863f-e9879c6d519f', 'volume_size': 1} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-688480209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b569fa-f291-4e48-863f-e9879c6d519f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:06Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Creating volume 20b569fa-f291-4e48-863f-e9879c6d519f {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:06 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:06 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f 1073741824 Jun 23 12:50:06 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:06 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.721s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:06 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Deleted volume successfully. Jun 23 12:50:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-91c029f7-1ddc-4776-bcb8-af57ef06be55 tempest-VolumesDeleteCascade-1660671785 None] Lock "cinder-ddc5b190-31aa-4f46-953b-7452ae9e6e4e-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:07 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=140,cinder:SELECT=104,cinder:DELETE=10,cinder:INSERT=30 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:50:07 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f 1073741824" returned: 0 in 1.047s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:07 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f Jun 23 12:50:07 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:08 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f" returned: 0 in 0.680s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.690s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:08 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Cloning volume 6ceee843-107b-406e-b22a-207e75966713 to volume 9072bda1-8336-42cc-b5fe-a05709a4c4c0 Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc931c7-3706-4bf2-8a30-e7044bddf33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b569fa-f291-4e48-863f-e9879c6d519f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b628538-f3c4-4149-9385-72b7ec9edb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Creating offline snapshot cb6a0d82-dd06-4e05-83c5-46fccc378e40 of volume 6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:50:08 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Volume volume-20b569fa-f291-4e48-863f-e9879c6d519f (20b569fa-f291-4e48-863f-e9879c6d519f): created successfully Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b628538-f3c4-4149-9385-72b7ec9edb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (a33503df-1e97-4a19-a164-e3bf73dc3d8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2121c03f-f538-4cd8-a6ed-bc5bdc2c4bbc]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:08 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-163a31c9-1602-4c2a-9b6e-5f1c1a2fce45 tempest-VolumesActionsTest-878581220 None] Created volume successfully. Jun 23 12:50:08 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 Jun 23 12:50:08 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:09 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713" returned: 0 in 0.779s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:09 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 1G Jun 23 12:50:09 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-20b569fa-f291-4e48-863f-e9879c6d519f-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Lock "cinder-20b569fa-f291-4e48-863f-e9879c6d519f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Acquiring lock "cinder-quobyte-20b569fa-f291-4e48-863f-e9879c6d519f" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-20b569fa-f291-4e48-863f-e9879c6d519f" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e27961-5caa-4185-b1d1-587817e183ac]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:09 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f Jun 23 12:50:09 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:09 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 1G" returned: 0 in 0.871s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceee843-107b-406e-b22a-207e75966713 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:09 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceee843-107b-406e-b22a-207e75966713 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 Jun 23 12:50:09 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:10 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f" returned: 0 in 0.798s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:10 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f Jun 23 12:50:10 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:10 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ceee843-107b-406e-b22a-207e75966713 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40" returned: 0 in 0.700s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:10 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:50:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:10 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 Jun 23 12:50:10 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Flow 'volume_create_manager' (223dc4c5-fff2-49d9-be3a-3e4079d17eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52d0dd2-03d2-4171-a321-e1cf0677d7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52d0dd2-03d2-4171-a321-e1cf0677d7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-917052222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c03a3c9-87db-42d0-b01d-569978ec8b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addef2fca3cd463099160e0966a02379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:11Z,use_quota=True,user_id='aa0abd781f654fb7a8b1db08017de968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4229b032-a42a-4cf3-a732-ad4a9c9ff4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4229b032-a42a-4cf3-a732-ad4a9c9ff4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:11 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b7663f-f9e3-47aa-be3c-297a551d04b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b7663f-f9e3-47aa-be3c-297a551d04b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c03a3c9-87db-42d0-b01d-569978ec8b04', 'volume_name': 'volume-1c03a3c9-87db-42d0-b01d-569978ec8b04', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c120c13-bf00-4578-88fd-c081c1c18255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c120c13-bf00-4578-88fd-c081c1c18255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7644235b-d673-46da-963a-4e315c12c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Volume 1c03a3c9-87db-42d0-b01d-569978ec8b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c03a3c9-87db-42d0-b01d-569978ec8b04', 'volume_size': 1} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-20b569fa-f291-4e48-863f-e9879c6d519f" returned: 0 in 0.704s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Lock "cinder-quobyte-20b569fa-f291-4e48-863f-e9879c6d519f" released by "delete_volume" :: held 1.540s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Created reservations ['0c6cb735-281e-4c71-9c54-f313bd73e680', '201200c1-1081-47c8-a425-69a9f19f890a', '2cfeaa2f-fd28-4ebe-81b6-47510278af9b', '37fae0a0-a448-4384-bcba-9c6b18f31f1b'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:11 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:11 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:11 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40" returned: 0 in 0.692s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:11 devstack sudo[105491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.info Jun 23 12:50:11 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:11 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.653s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Deleted volume successfully. Jun 23 12:50:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-174a9c9e-ef0f-4695-9cd0-59c5af7fd1a3 tempest-VolumesActionsTest-258801791 None] Lock "cinder-20b569fa-f291-4e48-863f-e9879c6d519f-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:12 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.info" returned: 0 in 0.667s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:12 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:12 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.info Jun 23 12:50:12 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (981118f4-ea7a-402b-ad46-56bf3179cc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d947c77-4030-4282-a99c-2d31be259560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d947c77-4030-4282-a99c-2d31be259560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566372798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc3603d-6358-45dc-9aaf-aa18825268e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:12Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6a72a9-5da2-4ce1-96b0-b6c1267218dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6a72a9-5da2-4ce1-96b0-b6c1267218dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b71013-caaf-44db-b305-be2c2d8b8971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b71013-caaf-44db-b305-be2c2d8b8971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc3603d-6358-45dc-9aaf-aa18825268e2', 'volume_name': 'volume-1cc3603d-6358-45dc-9aaf-aa18825268e2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab0238b-4c35-4d1e-8813-782471536ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab0238b-4c35-4d1e-8813-782471536ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960b63ce-c18f-4bf8-bb90-0bc1b1369b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:12 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Volume 1cc3603d-6358-45dc-9aaf-aa18825268e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc3603d-6358-45dc-9aaf-aa18825268e2', 'volume_size': 1} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:12 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.info" returned: 0 in 0.627s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Acquiring lock "cinder-quobyte-9072bda1-8336-42cc-b5fe-a05709a4c4c0" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-9072bda1-8336-42cc-b5fe-a05709a4c4c0" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] snapshot: cb6a0d82-dd06-4e05-83c5-46fccc378e40, volume: 9072bda1-8336-42cc-b5fe-a05709a4c4c0, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c091236-ff5d-4c02-a536-67d3a3f1ab16]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:12 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 Jun 23 12:50:12 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:13 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40" returned: 0 in 0.710s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ceee843-107b-406e-b22a-207e75966713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:50:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:50:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:50:13 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f076f7-b6b4-4cd3-851e-eac3d9c4854f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:13 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 Jun 23 12:50:13 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:14 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713" returned: 0 in 0.734s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:14 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:50:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:14 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 Jun 23 12:50:14 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:18 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0" returned: 0 in 4.306s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cb96ce-ba31-413a-beb7-e9f88e9bb588]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:18 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 Jun 23 12:50:18 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:19 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:19 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713, size 1024.00 MB, duration 4.31 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:50:19 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Converted 1024.00 MB image at 237.72 MB/s Jun 23 12:50:19 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 12:50:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:19 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 Jun 23 12:50:19 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:20 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0" returned: 0 in 0.676s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-9072bda1-8336-42cc-b5fe-a05709a4c4c0" released by "_copy_volume_from_snapshot" :: held 7.390s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Acquiring lock "cinder-quobyte-cb6a0d82-dd06-4e05-83c5-46fccc378e40" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-cb6a0d82-dd06-4e05-83c5-46fccc378e40" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Deleting offline snapshot cb6a0d82-dd06-4e05-83c5-46fccc378e40 of volume 6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] snapshot_file for this snap is: volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec98e374-cc9c-4705-86ef-4c9de86f73ec]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:20 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 Jun 23 12:50:20 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:20 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40" returned: 0 in 0.722s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ceee843-107b-406e-b22a-207e75966713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e272ef-0bbe-4647-9c32-aa2357d3b50a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:21 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 Jun 23 12:50:21 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:21 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713" returned: 0 in 0.731s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:21 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 Jun 23 12:50:21 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:22 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:22 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=129,cinder:INSERT=39,cinder:UPDATE=142,cinder:DELETE=16 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:50:22 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40" returned: 0 in 0.728s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:22 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40 Jun 23 12:50:22 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:22 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.652s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:50:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:50:23 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713.cb6a0d82-dd06-4e05-83c5-46fccc378e40" returned: 0 in 0.637s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-cb6a0d82-dd06-4e05-83c5-46fccc378e40" released by "_delete_snapshot" :: held 2.902s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.896s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.925s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-917052222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c03a3c9-87db-42d0-b01d-569978ec8b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addef2fca3cd463099160e0966a02379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:11Z,use_quota=True,user_id='aa0abd781f654fb7a8b1db08017de968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Creating volume 1c03a3c9-87db-42d0-b01d-569978ec8b04 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:23 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:23 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 1073741824 Jun 23 12:50:23 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:23 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9cd08b9d-92ec-4b19-bc2a-f334286ee69a tempest-GroupsV314Test-249194652 None] Create group from source-group-91a3daec-ad3f-41f8-9761-76bb5e3b4539 completed successfully. Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Acquiring lock "cinder-quobyte-9072bda1-8336-42cc-b5fe-a05709a4c4c0" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-9072bda1-8336-42cc-b5fe-a05709a4c4c0" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba458873-2a66-4498-9f20-59d164ba962c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:23 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 1073741824" returned: 0 in 0.875s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:23 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 Jun 23 12:50:23 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:24 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 Jun 23 12:50:24 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:24 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:24 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04" returned: 0 in 0.635s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.214s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1566372798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc3603d-6358-45dc-9aaf-aa18825268e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b8628088bb34b14bcfac1087f3d21a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:12Z,use_quota=True,user_id='0dba00f80ab647d2be1041312c9fb382',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Creating volume 1cc3603d-6358-45dc-9aaf-aa18825268e2 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:24 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0" returned: 0 in 0.790s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:24 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 1073741824 Jun 23 12:50:24 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7644235b-d673-46da-963a-4e315c12c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c03a3c9-87db-42d0-b01d-569978ec8b04', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:24 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0 Jun 23 12:50:24 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ccc951-370b-497c-8b4b-6a1bb5d4ef90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Volume volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 (1c03a3c9-87db-42d0-b01d-569978ec8b04): created successfully Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1ccc951-370b-497c-8b4b-6a1bb5d4ef90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Flow 'volume_create_manager' (223dc4c5-fff2-49d9-be3a-3e4079d17eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a3744c8e-3210-4158-b706-3896c161a3ca tempest-VolumesTransfersTest-2124758467 None] Created volume successfully. Jun 23 12:50:25 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9072bda1-8336-42cc-b5fe-a05709a4c4c0" returned: 0 in 0.706s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-9072bda1-8336-42cc-b5fe-a05709a4c4c0" released by "delete_volume" :: held 1.544s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Created reservations ['865c20dd-cd36-47d5-bf5f-3d187156c286'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:25 devstack cinder-volume[93659]: WARNING cinder.quota [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-585213939 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-585213939, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:50:25 devstack cinder-volume[93659]: WARNING cinder.quota [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-585213939 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-585213939, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Created reservations ['255d3c35-f875-4a18-ba95-d642660c0e0e', '28de1a11-e3f0-4cfb-9264-4071652e306b', '887f6dd7-3ac9-4cc4-86e3-84b4d559c107', '420f9d40-1d0d-4d2b-b2ee-437af5caac79'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:25 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 1073741824" returned: 0 in 0.945s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:25 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:25 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:25 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 Jun 23 12:50:25 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:25 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-25f54f73-29c6-48a4-9d15-7aa7f0ffca76 tempest-VolumesTransfersTest-1178406566 None] Transfer volume completed successfully. Jun 23 12:50:26 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.669s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:26 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b566c8ff-bdc4-4962-bb02-4c03dccc0625 tempest-GroupsV314Test-249194652 None] Delete group completed successfully. Jun 23 12:50:26 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2" returned: 0 in 0.707s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960b63ce-c18f-4bf8-bb90-0bc1b1369b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc3603d-6358-45dc-9aaf-aa18825268e2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3e1ebc-adb1-4d11-94d8-c557dd59fa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Volume volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 (1cc3603d-6358-45dc-9aaf-aa18825268e2): created successfully Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3e1ebc-adb1-4d11-94d8-c557dd59fa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Flow 'volume_create_manager' (981118f4-ea7a-402b-ad46-56bf3179cc65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:26 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-703b2253-69ab-4706-abed-51752c805e75 tempest-VolumesActionsTest-878581220 None] Created volume successfully. Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Acquiring lock "cinder-quobyte-6ceee843-107b-406e-b22a-207e75966713" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-6ceee843-107b-406e-b22a-207e75966713" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4569dc2b-c968-49b2-a4c8-4fee17fca004]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:26 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 Jun 23 12:50:26 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Acquiring lock "cinder-1c03a3c9-87db-42d0-b01d-569978ec8b04-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-1c03a3c9-87db-42d0-b01d-569978ec8b04-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Acquiring lock "cinder-quobyte-1c03a3c9-87db-42d0-b01d-569978ec8b04" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-quobyte-1c03a3c9-87db-42d0-b01d-569978ec8b04" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd57ce7-7fd5-48e3-9775-944a09725c68]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:27 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 Jun 23 12:50:27 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Acquiring lock "cinder-1cc3603d-6358-45dc-9aaf-aa18825268e2-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Lock "cinder-1cc3603d-6358-45dc-9aaf-aa18825268e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Acquiring lock "cinder-quobyte-1cc3603d-6358-45dc-9aaf-aa18825268e2" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Lock "cinder-quobyte-1cc3603d-6358-45dc-9aaf-aa18825268e2" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfd7524-d2b6-481c-9820-97ad1ee1abbb]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:27 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713" returned: 0 in 0.896s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:27 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713 Jun 23 12:50:27 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:27 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 Jun 23 12:50:27 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:27 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04" returned: 0 in 0.812s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:27 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04 Jun 23 12:50:27 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:28 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6ceee843-107b-406e-b22a-207e75966713" returned: 0 in 0.697s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Lock "cinder-quobyte-6ceee843-107b-406e-b22a-207e75966713" released by "delete_volume" :: held 1.667s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:28 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:28 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2 Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Created reservations ['7f00aa86-a9a8-4abc-93e4-75483aa70844'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:28 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Created reservations ['68d53329-fe5f-4b8d-8bb8-a81bcf55044e', '9ef44bfb-b1e9-491f-b607-03d8901b1b39', '9026709a-b18f-4d59-8e16-51fcd0d4bbe5', 'e16e337b-7ed9-4d00-9cf3-a127bc018408'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:28 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:28 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:28 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1c03a3c9-87db-42d0-b01d-569978ec8b04" returned: 0 in 0.783s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-quobyte-1c03a3c9-87db-42d0-b01d-569978ec8b04" released by "delete_volume" :: held 1.644s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Created reservations ['0faf0cfb-5415-4f27-bf29-811d8840b12e', '571d32ba-4c78-4380-82ed-d7eaf98946a0', 'ec496c51-558a-4590-b728-a69a3d9ef55a', 'b3bcf45d-5761-4940-a1e5-dfe85fc603bf'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:28 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:28 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:29 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-1cc3603d-6358-45dc-9aaf-aa18825268e2" returned: 0 in 0.758s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Lock "cinder-quobyte-1cc3603d-6358-45dc-9aaf-aa18825268e2" released by "delete_volume" :: held 1.660s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Created reservations ['a1e1e69d-2d9b-45e9-8b17-ba1b2f40f020', '9f961499-6214-4ffa-af76-8de8eb19375b', '9808ab18-7f12-4d8b-8055-cd52dff5594c', 'd1435134-9050-4dca-b92f-30703b0dd7d4'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:29 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.795s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b9db70a0-4bb8-44e5-ad17-5787e27a7ed2 tempest-GroupsV314Test-249194652 None] Delete group completed successfully. Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.018s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:29 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:29 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:29 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.811s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Deleted volume successfully. Jun 23 12:50:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-314b4164-52cf-48f6-822b-6ff2b4c91c48 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-1c03a3c9-87db-42d0-b01d-569978ec8b04-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Flow 'volume_create_manager' (5dabe963-9d5c-497b-a443-6a23d71cfd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9a1bf3-11c2-4ecd-94a3-f14d85ff98e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9a1bf3-11c2-4ecd-94a3-f14d85ff98e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2102235290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d00a5b8-62e9-491b-a821-8726647ec2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addef2fca3cd463099160e0966a02379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:30Z,use_quota=True,user_id='aa0abd781f654fb7a8b1db08017de968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c09ff0-cdf6-4446-8e52-9c208a30de95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c09ff0-cdf6-4446-8e52-9c208a30de95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8368fa-bd62-4611-9ab2-7027af3667fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd8368fa-bd62-4611-9ab2-7027af3667fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d00a5b8-62e9-491b-a821-8726647ec2fb', 'volume_name': 'volume-9d00a5b8-62e9-491b-a821-8726647ec2fb', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378b217f-0b11-4ce2-b3f4-a241ca2d2025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378b217f-0b11-4ce2-b3f4-a241ca2d2025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d21de11-5fd2-4194-b4a5-8db2fa18773a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:30 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Volume 9d00a5b8-62e9-491b-a821-8726647ec2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d00a5b8-62e9-491b-a821-8726647ec2fb', 'volume_size': 1} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2102235290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d00a5b8-62e9-491b-a821-8726647ec2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='addef2fca3cd463099160e0966a02379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:30Z,use_quota=True,user_id='aa0abd781f654fb7a8b1db08017de968',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Creating volume 9d00a5b8-62e9-491b-a821-8726647ec2fb {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:30 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:30 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb 1073741824 Jun 23 12:50:30 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:30 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.969s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Deleted volume successfully. Jun 23 12:50:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e292015c-42e7-45d3-accc-5b4b203471e9 tempest-VolumesActionsTest-878581220 None] Lock "cinder-1cc3603d-6358-45dc-9aaf-aa18825268e2-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:31 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb 1073741824" returned: 0 in 1.161s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:31 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb Jun 23 12:50:31 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:32 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb" returned: 0 in 0.822s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d21de11-5fd2-4194-b4a5-8db2fa18773a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d00a5b8-62e9-491b-a821-8726647ec2fb', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f6c3c-15e9-452f-b6f4-79424b5e6acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:32 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Volume volume-9d00a5b8-62e9-491b-a821-8726647ec2fb (9d00a5b8-62e9-491b-a821-8726647ec2fb): created successfully Jun 23 12:50:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66f6c3c-15e9-452f-b6f4-79424b5e6acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Flow 'volume_create_manager' (5dabe963-9d5c-497b-a443-6a23d71cfd4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-48cdffe5-4568-483e-ae1c-eed4d57c7347 tempest-VolumesTransfersTest-2124758467 None] Created volume successfully. Jun 23 12:50:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Acquiring lock "cinder-9d00a5b8-62e9-491b-a821-8726647ec2fb-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-9d00a5b8-62e9-491b-a821-8726647ec2fb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Acquiring lock "cinder-quobyte-9d00a5b8-62e9-491b-a821-8726647ec2fb" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-quobyte-9d00a5b8-62e9-491b-a821-8726647ec2fb" acquired by "delete_volume" :: waited 0.041s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:33 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51c7666-140b-49a4-85cd-63668b915d2f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:33 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb Jun 23 12:50:33 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:34 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb" returned: 0 in 0.859s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:34 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb Jun 23 12:50:34 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:35 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9d00a5b8-62e9-491b-a821-8726647ec2fb" returned: 0 in 0.696s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-quobyte-9d00a5b8-62e9-491b-a821-8726647ec2fb" released by "delete_volume" :: held 1.644s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Created reservations ['925f5078-abb6-4a84-beb8-4d5cbd253132', '0fa7b183-d34e-44d6-9443-f81d66d136c9', 'a37850a2-f3f5-4ed6-bd02-0d211446f79a', '4e84c79f-d09e-4e24-904b-f5377180e2bb'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:35 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:50:35 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:36 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.866s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:50:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Deleted volume successfully. Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Flow 'volume_create_manager' (e484727a-1838-4f7b-8f44-f8302b538aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a007bf7-6afd-4db0-9fba-5b13d39fd3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a007bf7-6afd-4db0-9fba-5b13d39fd3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-750100810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda468d2-2744-438c-90bf-3760fa7519e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c8b1b4ed954ce28fc0faa5711881be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:36Z,use_quota=True,user_id='891a50bd1a8848f692620bb50640a1e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83e3c7d-a7c3-4276-8854-1ae44ecddae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f83e3c7d-a7c3-4276-8854-1ae44ecddae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471e3acb-98d8-4f6b-9bf2-b68f07dc4af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471e3acb-98d8-4f6b-9bf2-b68f07dc4af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cda468d2-2744-438c-90bf-3760fa7519e2', 'volume_name': 'volume-cda468d2-2744-438c-90bf-3760fa7519e2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f962d341-f9ea-4515-bdcf-8f0398a2c68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f962d341-f9ea-4515-bdcf-8f0398a2c68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b8b728-0c74-4040-925f-d6a93f0172bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:36 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Volume cda468d2-2744-438c-90bf-3760fa7519e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cda468d2-2744-438c-90bf-3760fa7519e2', 'volume_size': 1} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-750100810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cda468d2-2744-438c-90bf-3760fa7519e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c8b1b4ed954ce28fc0faa5711881be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:36Z,use_quota=True,user_id='891a50bd1a8848f692620bb50640a1e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Creating volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:36 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4757d818-39b7-4896-9047-4c43e0ab0483 tempest-VolumesTransfersTest-332269556 None] Lock "cinder-9d00a5b8-62e9-491b-a821-8726647ec2fb-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:36 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 1073741824 Jun 23 12:50:36 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:37 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 1073741824" returned: 0 in 1.002s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:37 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 Jun 23 12:50:37 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:38 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2" returned: 0 in 0.806s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b8b728-0c74-4040-925f-d6a93f0172bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cda468d2-2744-438c-90bf-3760fa7519e2', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafd75eb-b954-4a3a-8c40-cbdfb2745b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:38 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Volume volume-cda468d2-2744-438c-90bf-3760fa7519e2 (cda468d2-2744-438c-90bf-3760fa7519e2): created successfully Jun 23 12:50:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafd75eb-b954-4a3a-8c40-cbdfb2745b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Flow 'volume_create_manager' (e484727a-1838-4f7b-8f44-f8302b538aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2cb388f0-cb2a-4500-ab13-905ba2153493 tempest-SnapshotsActionsTest-746487844 None] Created volume successfully. Jun 23 12:50:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Creating offline snapshot e000877c-1da7-4e99-99c1-10ae15cda312 of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:50:39 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[af00b12e-0086-463d-b153-d850bd1ead29]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:39 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 Jun 23 12:50:39 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:40 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2" returned: 0 in 0.904s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:40 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 1G Jun 23 12:50:40 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:41 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 1G" returned: 0 in 0.945s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:41 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:50:41 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:42 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.802s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:42 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 is being set with open permissions: ugo+rw Jun 23 12:50:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:42 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:50:42 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:43 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.759s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:43 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.info Jun 23 12:50:43 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:43 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.info" returned: 0 in 0.768s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:43 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.info is being set with open permissions: ugo+rw Jun 23 12:50:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:43 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.info Jun 23 12:50:43 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:44 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.info" returned: 0 in 0.748s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.050s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:44 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0a7508fc-fca5-4f4d-8746-e1b3f85b85ca tempest-SnapshotsActionsTest-746487844 None] Create snapshot completed successfully Jun 23 12:50:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Creating offline snapshot c6e18c46-3493-41c1-9f5a-e989f97a959b of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:50:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[392ba2c8-bad2-47d2-bf5b-34b32520b58a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:45 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:50:45 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Flow 'volume_create_manager' (70d6183d-6924-4080-b856-e313f483aca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ba166-a333-4fd3-af43-a152a84aa933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ba166-a333-4fd3-af43-a152a84aa933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1311586645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c44c3-6fb4-4fa5-afb5-654834ca5499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fc1e6d3ad4412a9f34e52aab94c8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:46Z,use_quota=True,user_id='e8c23d839e064834b87cc1e2dbfedaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0308462-155a-493c-94f6-671f418dbf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0308462-155a-493c-94f6-671f418dbf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f56aa6-17b3-4cde-be7c-546cb9b4ceec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f56aa6-17b3-4cde-be7c-546cb9b4ceec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795c44c3-6fb4-4fa5-afb5-654834ca5499', 'volume_name': 'volume-795c44c3-6fb4-4fa5-afb5-654834ca5499', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b529a1f5-0a31-411a-ba21-4b85b3bec794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b529a1f5-0a31-411a-ba21-4b85b3bec794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffa8393-0ff9-4a9a-83fb-43b94de2d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:46 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Volume 795c44c3-6fb4-4fa5-afb5-654834ca5499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795c44c3-6fb4-4fa5-afb5-654834ca5499', 'volume_size': 1} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:46 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.853s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:50:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:46 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b 1G Jun 23 12:50:46 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:47 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b 1G" returned: 0 in 0.973s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:47 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b Jun 23 12:50:47 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:48 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b" returned: 0 in 0.826s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:48 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b is being set with open permissions: ugo+rw Jun 23 12:50:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:48 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b Jun 23 12:50:48 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:49 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b" returned: 0 in 0.653s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.439s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.817s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1311586645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795c44c3-6fb4-4fa5-afb5-654834ca5499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57fc1e6d3ad4412a9f34e52aab94c8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:46Z,use_quota=True,user_id='e8c23d839e064834b87cc1e2dbfedaad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Creating volume 795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:49 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:49 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 1073741824 Jun 23 12:50:49 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:49 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8799ad72-ceb0-494e-be14-aecc941386eb tempest-SnapshotsActionsTest-746487844 None] Create snapshot completed successfully Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-c6e18c46-3493-41c1-9f5a-e989f97a959b-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-c6e18c46-3493-41c1-9f5a-e989f97a959b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-c6e18c46-3493-41c1-9f5a-e989f97a959b" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-c6e18c46-3493-41c1-9f5a-e989f97a959b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Deleting offline snapshot c6e18c46-3493-41c1-9f5a-e989f97a959b of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] snapshot_file for this snap is: volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8bfbce-bb16-4b8d-b1fb-dfd4a72c997e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:50 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 1073741824" returned: 0 in 1.049s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:50 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b Jun 23 12:50:50 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:50 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 Jun 23 12:50:50 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:50 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499" returned: 0 in 0.747s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ffa8393-0ff9-4a9a-83fb-43b94de2d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795c44c3-6fb4-4fa5-afb5-654834ca5499', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2373d08a-6a4f-433f-85c2-22dcd9841922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:51 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Volume volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 (795c44c3-6fb4-4fa5-afb5-654834ca5499): created successfully Jun 23 12:50:51 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2373d08a-6a4f-433f-85c2-22dcd9841922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Flow 'volume_create_manager' (70d6183d-6924-4080-b856-e313f483aca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b" returned: 0 in 0.996s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:50:51 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-bb8eaf26-c31c-4860-9357-3eb1bb853f0c tempest-SnapshotMetadataTestJSON-1721389900 None] Created volume successfully. Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6875ac16-972b-4637-b8d5-22b661e6a1c1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:51 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:50:51 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Flow 'volume_create_manager' (4fff8b4c-bec6-4fe9-abac-85a54ee57026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec3f9f-3559-4a5b-9f31-0bdc70e628bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ec3f9f-3559-4a5b-9f31-0bdc70e628bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645637801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748e9d1d-b989-43cd-bf12-8ba2047ae06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06fccd592cc146cc8ba833759ddfa0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:51Z,use_quota=True,user_id='b1c3e2b63b1448f48b6247712f14ecb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62204b4b-f229-4c29-a7a0-0140d0f88930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62204b4b-f229-4c29-a7a0-0140d0f88930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3700682-9bc1-434e-bcb8-268107fa17db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3700682-9bc1-434e-bcb8-268107fa17db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748e9d1d-b989-43cd-bf12-8ba2047ae06f', 'volume_name': 'volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39f24de-dcda-417a-9438-5394f7333d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39f24de-dcda-417a-9438-5394f7333d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96145289-4df4-42e8-8762-cf2ef51fbc59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:51 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Volume 748e9d1d-b989-43cd-bf12-8ba2047ae06f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f', 'volume_size': 1} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1645637801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748e9d1d-b989-43cd-bf12-8ba2047ae06f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06fccd592cc146cc8ba833759ddfa0cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:50:51Z,use_quota=True,user_id='b1c3e2b63b1448f48b6247712f14ecb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Creating volume 748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:50:51 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:51 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f 1073741824 Jun 23 12:50:51 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:51 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.798s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:50:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:51 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b Jun 23 12:50:51 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:52 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f 1073741824" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:52 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:50:52 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:52 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b" returned: 0 in 0.802s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:52 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b Jun 23 12:50:52 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:53 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 0.630s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.479s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96145289-4df4-42e8-8762-cf2ef51fbc59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7fb820-3a6c-475f-9c7e-ad4aca85783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Creating offline snapshot 51ad814a-1380-4068-b51c-7155a85d1d58 of volume 795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:50:53 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Volume volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f (748e9d1d-b989-43cd-bf12-8ba2047ae06f): created successfully Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d7fb820-3a6c-475f-9c7e-ad4aca85783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Flow 'volume_create_manager' (4fff8b4c-bec6-4fe9-abac-85a54ee57026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec635068-c857-45a9-870c-3eed68641583]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:53 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-3b0c54f2-00b0-4bc0-b5ef-f0ada6fdc995 tempest-VolumesActionsTest-1514526071 None] Created volume successfully. Jun 23 12:50:53 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 Jun 23 12:50:53 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:53 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.c6e18c46-3493-41c1-9f5a-e989f97a959b" returned: 0 in 0.680s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-c6e18c46-3493-41c1-9f5a-e989f97a959b" released by "_delete_snapshot" :: held 3.401s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" released by "delete_snapshot" :: held 3.425s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Created reservations ['b9870412-29fe-46e0-9b99-f17354e9a411', '673375af-e551-4832-8f31-b41b26505417', '9d97362f-58a8-4dec-be95-21ec86533533', '89a26dfa-45e7-422c-8740-bdc0b4f7ef5e'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:50:53 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Delete snapshot completed successfully. Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-550fa984-fc47-4b60-8c47-2e9b7fbe8804 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-c6e18c46-3493-41c1-9f5a-e989f97a959b-delete_snapshot" released by "delete_snapshot" :: held 3.590s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:50:53 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499" returned: 0 in 0.855s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:54 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 1G Jun 23 12:50:54 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:50:54 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 1G" returned: 0 in 0.865s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:54 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 Jun 23 12:50:54 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:55 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58" returned: 0 in 0.708s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:55 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 is being set with open permissions: ugo+rw Jun 23 12:50:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:55 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 Jun 23 12:50:55 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:56 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58" returned: 0 in 0.648s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:56 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.info Jun 23 12:50:56 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:56 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.info" returned: 0 in 0.682s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:56 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.info is being set with open permissions: ugo+rw Jun 23 12:50:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:56 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.info Jun 23 12:50:56 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:57 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.info" returned: 0 in 0.621s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.511s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:50:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.943s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:50:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Creating offline snapshot fd8592e5-8279-4173-b363-f36aee91c58c of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:50:57 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11e0f01-d62a-4cdc-ae03-1be3e0086144]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-1d0664e1-3fbc-4ce3-903d-ec7531d5f8fb tempest-SnapshotMetadataTestJSON-1721389900 None] Create snapshot completed successfully Jun 23 12:50:57 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:50:57 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:58 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.830s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:58 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c 1G Jun 23 12:50:58 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "cinder-51ad814a-1380-4068-b51c-7155a85d1d58-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-51ad814a-1380-4068-b51c-7155a85d1d58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "cinder-quobyte-795c44c3-6fb4-4fa5-afb5-654834ca5499" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-quobyte-795c44c3-6fb4-4fa5-afb5-654834ca5499" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "cinder-quobyte-51ad814a-1380-4068-b51c-7155a85d1d58" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-quobyte-51ad814a-1380-4068-b51c-7155a85d1d58" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Deleting offline snapshot 51ad814a-1380-4068-b51c-7155a85d1d58 of volume 795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] snapshot_file for this snap is: volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e26cb-3ad6-4c07-b2c5-80c18cb537b2]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:58 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 Jun 23 12:50:58 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:59 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c 1G" returned: 0 in 0.879s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:59 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c Jun 23 12:50:59 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:50:59 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jun 23 12:50:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58" returned: 0 in 0.830s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:50:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-795c44c3-6fb4-4fa5-afb5-654834ca5499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:50:59 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e35148-bc63-4351-88be-1ff27adb1f0d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:50:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:50:59 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 Jun 23 12:50:59 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:00 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c" returned: 0 in 0.791s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:00 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c is being set with open permissions: ugo+rw Jun 23 12:51:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:00 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c Jun 23 12:51:00 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:00 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499" returned: 0 in 1.038s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:00 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 Jun 23 12:51:00 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:00 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c" returned: 0 in 0.838s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-cd611faa-06a5-4012-8866-1d9691b1b25b tempest-SnapshotsActionsTest-746487844 None] Create snapshot completed successfully Jun 23 12:51:01 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58" returned: 0 in 0.797s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:01 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58 Jun 23 12:51:01 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-fd8592e5-8279-4173-b363-f36aee91c58c-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:02 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-fd8592e5-8279-4173-b363-f36aee91c58c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499.51ad814a-1380-4068-b51c-7155a85d1d58" returned: 0 in 0.729s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-fd8592e5-8279-4173-b363-f36aee91c58c" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-quobyte-51ad814a-1380-4068-b51c-7155a85d1d58" released by "_delete_snapshot" :: held 3.541s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-quobyte-795c44c3-6fb4-4fa5-afb5-654834ca5499" released by "delete_snapshot" :: held 3.566s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-fd8592e5-8279-4173-b363-f36aee91c58c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Deleting offline snapshot fd8592e5-8279-4173-b363-f36aee91c58c of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] snapshot_file for this snap is: volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff43963-c699-4552-b9f3-47e7196868f4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Created reservations ['4df5d60f-e506-478a-9827-06abdab17fca', '004d9c0b-a3f7-4fd4-8f82-e3447e90a621', '42f68339-94ef-4372-967f-62fac14f90e3', '708b3bd5-34db-431a-8f60-8c942c7a0dc0'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:02 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c Jun 23 12:51:02 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Delete snapshot completed successfully. Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5714fb8-6430-4c45-aa6e-c523fc9189c1 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-51ad814a-1380-4068-b51c-7155a85d1d58-delete_snapshot" released by "delete_snapshot" :: held 3.750s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "cinder-795c44c3-6fb4-4fa5-afb5-654834ca5499-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-795c44c3-6fb4-4fa5-afb5-654834ca5499-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "cinder-quobyte-795c44c3-6fb4-4fa5-afb5-654834ca5499" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-quobyte-795c44c3-6fb4-4fa5-afb5-654834ca5499" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:02 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c" returned: 0 in 0.835s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc2d9b4-534b-489d-8916-bfef85f7c349]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadbcaf0-23bd-4db6-b87d-9811bead3370]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:03 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 Jun 23 12:51:03 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:03 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:03 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:03 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.788s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:03 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499" returned: 0 in 0.836s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:03 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c Jun 23 12:51:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:03 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:03 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499 Jun 23 12:51:03 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:04 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-795c44c3-6fb4-4fa5-afb5-654834ca5499" returned: 0 in 0.650s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-quobyte-795c44c3-6fb4-4fa5-afb5-654834ca5499" released by "delete_volume" :: held 1.577s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Created reservations ['4b1c8605-89de-46f3-aba8-8d5e257b735c', 'efa798fb-943c-43b1-99e7-860a9ad0625d', '9e3ec708-8659-4782-ba79-f4c8dda798c3', 'c872ea3f-2226-4fa9-a3f6-bfad086e5b0c'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:04 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c" returned: 0 in 0.820s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:04 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c Jun 23 12:51:04 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:04 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:51:04 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:05 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fd8592e5-8279-4173-b363-f36aee91c58c" returned: 0 in 0.691s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-fd8592e5-8279-4173-b363-f36aee91c58c" released by "_delete_snapshot" :: held 3.242s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:05 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" released by "delete_snapshot" :: held 3.272s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.708s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:51:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Deleted volume successfully. Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a5df53c4-8884-414d-93a1-c2f26b512b69 tempest-SnapshotMetadataTestJSON-1721389900 None] Lock "cinder-795c44c3-6fb4-4fa5-afb5-654834ca5499-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Created reservations ['1e164986-4ad0-4335-9af4-5001b362759c', '9c281257-6d31-4593-8e34-4e87f7a1164a', 'a639c62f-80d3-4b82-b169-147e76451a49', '3abd35a7-65f3-4292-82ba-065f17a10a13'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Delete snapshot completed successfully. Jun 23 12:51:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1deddfb5-f7e1-45e6-96e5-5515be25813c tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-fd8592e5-8279-4173-b363-f36aee91c58c-delete_snapshot" released by "delete_snapshot" :: held 3.464s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Creating offline snapshot fded9483-bca7-4d59-ac69-c573f2e09412 of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:51:06 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4024dac-ff28-4fd6-be9c-9ed89f130f2d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:06 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:06 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:08 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 1.320s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:08 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:08 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 1G Jun 23 12:51:08 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:09 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 1G" returned: 0 in 1.077s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:09 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 Jun 23 12:51:09 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:10 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412" returned: 0 in 1.071s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:10 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 is being set with open permissions: ugo+rw Jun 23 12:51:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:10 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 Jun 23 12:51:10 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:10 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412" returned: 0 in 0.827s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=89,cinder:UPDATE=117,cinder:INSERT=27,cinder:DELETE=2 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.456s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-50732544-b6f5-4500-be93-c9d52eb192a6 tempest-SnapshotsActionsTest-746487844 None] Create snapshot completed successfully Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a2ecccb9-2d53-4fd7-9386-2ae9562b66b3 tempest-VolumesActionsTest-1514526071 None] Acquiring lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f" by "attach_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a2ecccb9-2d53-4fd7-9386-2ae9562b66b3 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f" acquired by "attach_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a2ecccb9-2d53-4fd7-9386-2ae9562b66b3 tempest-VolumesActionsTest-1514526071 None] Attaching volume 748e9d1d-b989-43cd-bf12-8ba2047ae06f to instance e6574c37-a592-4c8d-8e8b-e29a196163a0 at mountpoint /dev/vdb on host None. Jun 23 12:51:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a2ecccb9-2d53-4fd7-9386-2ae9562b66b3 tempest-VolumesActionsTest-1514526071 None] Attach volume completed successfully. Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a2ecccb9-2d53-4fd7-9386-2ae9562b66b3 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f" released by "attach_volume" :: held 0.108s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Flow 'volume_create_manager' (35f12f53-9791-43ba-9390-985a1515b859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853f7a0c-a60b-43cf-87d8-40377715a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853f7a0c-a60b-43cf-87d8-40377715a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1058479872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617f007d-7f6d-4651-8570-6b540b1aceee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c0d2739412443a7aa2a443c300ab80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:12Z,use_quota=True,user_id='862a261eaab34298b8950fff6e755a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cf6d79-0603-4cbf-be40-dd28c78cb0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cf6d79-0603-4cbf-be40-dd28c78cb0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257af259-6824-4156-9263-a368bd4bb904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257af259-6824-4156-9263-a368bd4bb904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617f007d-7f6d-4651-8570-6b540b1aceee', 'volume_name': 'volume-617f007d-7f6d-4651-8570-6b540b1aceee', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8184db-2194-4df9-b47d-efaa1a7e869b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec8184db-2194-4df9-b47d-efaa1a7e869b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c379832-0e2f-4647-bf2f-ecd982fb909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Volume 617f007d-7f6d-4651-8570-6b540b1aceee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617f007d-7f6d-4651-8570-6b540b1aceee', 'volume_size': 1} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1058479872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617f007d-7f6d-4651-8570-6b540b1aceee,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c0d2739412443a7aa2a443c300ab80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:12Z,use_quota=True,user_id='862a261eaab34298b8950fff6e755a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Creating volume 617f007d-7f6d-4651-8570-6b540b1aceee {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:51:11 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:51:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:12 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee 1073741824 Jun 23 12:51:12 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-fded9483-bca7-4d59-ac69-c573f2e09412-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e46808f-eb23-49a0-8135-4228c93923a2 tempest-VolumesActionsTest-1514526071 None] Acquiring lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-detach_volume" by "detach_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-fded9483-bca7-4d59-ac69-c573f2e09412-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e46808f-eb23-49a0-8135-4228c93923a2 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4e46808f-eb23-49a0-8135-4228c93923a2 tempest-VolumesActionsTest-1514526071 None] Detaching volume 748e9d1d-b989-43cd-bf12-8ba2047ae06f from instance e6574c37-a592-4c8d-8e8b-e29a196163a0. Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-fded9483-bca7-4d59-ac69-c573f2e09412" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-fded9483-bca7-4d59-ac69-c573f2e09412" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Deleting offline snapshot fded9483-bca7-4d59-ac69-c573f2e09412 of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] snapshot_file for this snap is: volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ccce20-4336-4203-877f-e832893fc41d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4e46808f-eb23-49a0-8135-4228c93923a2 tempest-VolumesActionsTest-1514526071 None] Detach volume completed successfully. Jun 23 12:51:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e46808f-eb23-49a0-8135-4228c93923a2 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:12 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 Jun 23 12:51:12 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:13 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee 1073741824" returned: 0 in 1.061s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:13 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412" returned: 0 in 0.886s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9cce34-c19d-49ba-8482-5c18809dcc66]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:13 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee Jun 23 12:51:13 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:13 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:13 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:13 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee" returned: 0 in 0.699s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c379832-0e2f-4647-bf2f-ecd982fb909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617f007d-7f6d-4651-8570-6b540b1aceee', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0ab86f-e754-4eee-813b-a64363ddc886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:13 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Volume volume-617f007d-7f6d-4651-8570-6b540b1aceee (617f007d-7f6d-4651-8570-6b540b1aceee): created successfully Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0ab86f-e754-4eee-813b-a64363ddc886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Flow 'volume_create_manager' (35f12f53-9791-43ba-9390-985a1515b859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:13 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7a225e1d-c720-4ac3-b7df-2c9f83d44b47 tempest-VolumesListTestJSON-976812368 None] Created volume successfully. Jun 23 12:51:14 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.977s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:14 devstack sudo[106035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 Jun 23 12:51:14 devstack sudo[106035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:14 devstack sudo[106035]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412" returned: 0 in 0.863s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:15 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412 Jun 23 12:51:15 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:51:15 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Flow 'volume_create_manager' (d3965248-1ce4-4291-858d-a6e8bc3c05b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d97e17-6336-446f-a650-cb2c24d47b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.fded9483-bca7-4d59-ac69-c573f2e09412" returned: 0 in 0.686s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d97e17-6336-446f-a650-cb2c24d47b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1449657636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c820233-4562-4310-a316-3b6b254df0d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c0d2739412443a7aa2a443c300ab80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:16Z,use_quota=True,user_id='862a261eaab34298b8950fff6e755a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8208d26-e98f-4ba3-96d1-6c52a0cae6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8208d26-e98f-4ba3-96d1-6c52a0cae6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c924ab9a-f185-4456-9fe0-8bdb88aa21e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c924ab9a-f185-4456-9fe0-8bdb88aa21e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c820233-4562-4310-a316-3b6b254df0d6', 'volume_name': 'volume-8c820233-4562-4310-a316-3b6b254df0d6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a0457c-294d-4396-8c4f-6002e81deca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a0457c-294d-4396-8c4f-6002e81deca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6bf7e3-016f-44fe-bd14-e4fdfb246d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:15 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Volume 8c820233-4562-4310-a316-3b6b254df0d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c820233-4562-4310-a316-3b6b254df0d6', 'volume_size': 1} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1449657636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c820233-4562-4310-a316-3b6b254df0d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c0d2739412443a7aa2a443c300ab80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:16Z,use_quota=True,user_id='862a261eaab34298b8950fff6e755a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Creating volume 8c820233-4562-4310-a316-3b6b254df0d6 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:51:15 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-fded9483-bca7-4d59-ac69-c573f2e09412" released by "_delete_snapshot" :: held 3.607s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" released by "delete_snapshot" :: held 3.656s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:15 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 1073741824 Jun 23 12:51:15 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Created reservations ['6a7c67a5-f583-4400-b8a4-cd57db2e7fcf', '49b3e5c3-f055-4f7f-afe4-d7de9378afc8', '43e62e28-842b-4e05-acb3-d7a607d84018', 'b9bbb9d6-e36c-4a55-9cb0-ee0529078dd8'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:15 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Delete snapshot completed successfully. Jun 23 12:51:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b4b428cc-245e-40ba-a90b-62a83cf54d58 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-fded9483-bca7-4d59-ac69-c573f2e09412-delete_snapshot" released by "delete_snapshot" :: held 3.822s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:16 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 1073741824" returned: 0 in 0.900s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:16 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 Jun 23 12:51:16 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:17 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6" returned: 0 in 0.645s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.663s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6bf7e3-016f-44fe-bd14-e4fdfb246d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c820233-4562-4310-a316-3b6b254df0d6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dba9ba-5db4-4380-8ac2-45b7cb24b815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Creating offline snapshot ee343999-6ea6-4fd8-adee-cb3552a76bda of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:51:17 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Volume volume-8c820233-4562-4310-a316-3b6b254df0d6 (8c820233-4562-4310-a316-3b6b254df0d6): created successfully Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82dba9ba-5db4-4380-8ac2-45b7cb24b815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Flow 'volume_create_manager' (d3965248-1ce4-4291-858d-a6e8bc3c05b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92a2166-8022-4852-89e0-c5f3dfc48946]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9873a7ab-e654-4fdd-b4ef-0acfc984f667 tempest-VolumesListTestJSON-976812368 None] Created volume successfully. Jun 23 12:51:17 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:17 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:51:18 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Flow 'volume_create_manager' (aa107933-6d20-4bdf-81dc-8bfc8615ee74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861f3dcd-4bc3-4100-a71b-a5954f24aaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.817s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:18 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda 1G Jun 23 12:51:18 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (861f3dcd-4bc3-4100-a71b-a5954f24aaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1936651426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa683cac-e6dc-4ec6-a1da-7f912ffdc51a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c0d2739412443a7aa2a443c300ab80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:18Z,use_quota=True,user_id='862a261eaab34298b8950fff6e755a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e328a4-58da-4f30-b433-4f49c14bd3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e328a4-58da-4f30-b433-4f49c14bd3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b452a11f-c84a-480c-8404-e2ab1ceedf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b452a11f-c84a-480c-8404-e2ab1ceedf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa683cac-e6dc-4ec6-a1da-7f912ffdc51a', 'volume_name': 'volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0b5146-4144-42d1-a090-cfa2753a6101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0b5146-4144-42d1-a090-cfa2753a6101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a41f13-3fb7-4b7c-b3e9-6821dde6f1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:18 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Volume fa683cac-e6dc-4ec6-a1da-7f912ffdc51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a', 'volume_size': 1} Jun 23 12:51:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:19 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda 1G" returned: 0 in 0.814s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:19 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda Jun 23 12:51:19 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:19 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda" returned: 0 in 0.661s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:19 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda is being set with open permissions: ugo+rw Jun 23 12:51:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:19 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda Jun 23 12:51:19 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:20 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda" returned: 0 in 0.635s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.043s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.087s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1936651426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa683cac-e6dc-4ec6-a1da-7f912ffdc51a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1c0d2739412443a7aa2a443c300ab80d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:18Z,use_quota=True,user_id='862a261eaab34298b8950fff6e755a96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Creating volume fa683cac-e6dc-4ec6-a1da-7f912ffdc51a {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:51:20 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:20 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a 1073741824 Jun 23 12:51:20 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4ef9394e-5b16-4844-915a-6b598672c51c tempest-SnapshotsActionsTest-746487844 None] Create snapshot completed successfully Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-ee343999-6ea6-4fd8-adee-cb3552a76bda-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-ee343999-6ea6-4fd8-adee-cb3552a76bda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Acquiring lock "cinder-quobyte-ee343999-6ea6-4fd8-adee-cb3552a76bda" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-ee343999-6ea6-4fd8-adee-cb3552a76bda" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Deleting offline snapshot ee343999-6ea6-4fd8-adee-cb3552a76bda of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] snapshot_file for this snap is: volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c1c498-de32-41bc-aaa1-5db6fa82c1c6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:21 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda Jun 23 12:51:21 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:21 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a 1073741824" returned: 0 in 0.886s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:21 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a Jun 23 12:51:21 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:21 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda" returned: 0 in 0.814s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f202c-838f-473d-bf87-8a1d128bd38d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:22 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:22 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:22 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a" returned: 0 in 0.721s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76a41f13-3fb7-4b7c-b3e9-6821dde6f1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6210792e-28c7-47cd-8579-f717d257b15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:22 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Volume volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a (fa683cac-e6dc-4ec6-a1da-7f912ffdc51a): created successfully Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6210792e-28c7-47cd-8579-f717d257b15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Flow 'volume_create_manager' (aa107933-6d20-4bdf-81dc-8bfc8615ee74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:22 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-808dd0aa-1ebc-4ba5-bdd3-97bbc33f86f1 tempest-VolumesListTestJSON-976812368 None] Created volume successfully. Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:22 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:51:22 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:22 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.933s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:22 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda Jun 23 12:51:22 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:22 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.708s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:51:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:51:23 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda" returned: 0 in 0.794s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:23 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda Jun 23 12:51:23 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:24 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.ee343999-6ea6-4fd8-adee-cb3552a76bda" returned: 0 in 0.759s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-ee343999-6ea6-4fd8-adee-cb3552a76bda" released by "_delete_snapshot" :: held 3.400s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" released by "delete_snapshot" :: held 3.423s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=115,cinder:SELECT=95,cinder:INSERT=28,cinder:DELETE=14 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Created reservations ['98ca6e94-a380-4d27-856c-75708c2996bf', '841c08f9-987d-4bb3-bc62-59ed492b4ef4', 'b32782e5-ed10-4c66-b07c-fcb1c7731ddc', 'd47dd875-58cb-4e0d-85a6-5674303174b5'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Delete snapshot completed successfully. Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e797ef99-8de0-4abe-859e-40abe09124d8 tempest-SnapshotsActionsTest-721092398 None] Lock "cinder-ee343999-6ea6-4fd8-adee-cb3552a76bda-delete_snapshot" released by "delete_snapshot" :: held 3.574s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "cinder-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "cinder-quobyte-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-quobyte-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[74001837-1330-4619-bc46-7dca8b625bd3]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:25 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a Jun 23 12:51:25 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "cinder-e000877c-1da7-4e99-99c1-10ae15cda312-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-e000877c-1da7-4e99-99c1-10ae15cda312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "cinder-quobyte-e000877c-1da7-4e99-99c1-10ae15cda312" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-quobyte-e000877c-1da7-4e99-99c1-10ae15cda312" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Deleting offline snapshot e000877c-1da7-4e99-99c1-10ae15cda312 of volume cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] snapshot_file for this snap is: volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fc0b14-0b31-42e1-b2d2-087eb6ba5750]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:25 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a" returned: 0 in 0.802s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:25 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a Jun 23 12:51:25 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:25 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:25 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:26 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a" returned: 0 in 0.740s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-quobyte-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a" released by "delete_volume" :: held 1.587s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:26 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.841s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cda468d2-2744-438c-90bf-3760fa7519e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39564b5-525b-41d1-90e1-ea0aa4b1433f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Created reservations ['a4faf7e4-548a-4992-bf57-4838440de322', '7bb04dff-da37-43cc-a5a8-25186eeb4aeb', '62b1ec0c-e957-4151-bdf9-5f242d75cb61', '1f96fd3b-ffc0-40c4-86fb-ebb58899d8aa'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:26 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 Jun 23 12:51:26 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:26 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:51:26 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Acquiring lock "cinder-8c820233-4562-4310-a316-3b6b254df0d6-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Lock "cinder-8c820233-4562-4310-a316-3b6b254df0d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Acquiring lock "cinder-quobyte-8c820233-4562-4310-a316-3b6b254df0d6" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Lock "cinder-quobyte-8c820233-4562-4310-a316-3b6b254df0d6" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e960a-41f0-46e0-917e-6f0d5a846e2f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:27 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 Jun 23 12:51:27 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:27 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.899s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:51:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Deleted volume successfully. Jun 23 12:51:27 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2" returned: 0 in 1.075s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:27 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:27 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6c4983f4-ce6b-481d-bb7f-e891bb4d3eb9 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-fa683cac-e6dc-4ec6-a1da-7f912ffdc51a-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:28 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6" returned: 0 in 1.012s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:28 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6 Jun 23 12:51:28 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:28 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.976s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:28 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312 Jun 23 12:51:28 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:29 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8c820233-4562-4310-a316-3b6b254df0d6" returned: 0 in 0.737s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Lock "cinder-quobyte-8c820233-4562-4310-a316-3b6b254df0d6" released by "delete_volume" :: held 1.830s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Created reservations ['1eea0cda-1f53-4c68-b0fd-b80c25f50058', '4bf63beb-ef9f-411d-bc7a-8931156311cf', 'cd269ec5-71c9-44d9-a8ba-8681dba237e6', '671df7f7-d8f0-4568-9caf-40d1f74c5e57'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:29 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:51:29 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:29 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2.e000877c-1da7-4e99-99c1-10ae15cda312" returned: 0 in 0.667s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-quobyte-e000877c-1da7-4e99-99c1-10ae15cda312" released by "_delete_snapshot" :: held 3.678s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" released by "delete_snapshot" :: held 3.701s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Created reservations ['f4df2d66-660f-4119-b56a-f88ae183ded9', 'ef0ac8e1-0d07-4d1a-bbd2-1f353688b790', '618c6b9f-3466-40f8-a880-e336a4ece4aa', '54ef6fc7-322f-4fc6-9aa7-aaa80983a30a'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Delete snapshot completed successfully. Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6af5101d-561c-4f40-b05b-8418b05ed3c3 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-e000877c-1da7-4e99-99c1-10ae15cda312-delete_snapshot" released by "delete_snapshot" :: held 3.841s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "cinder-617f007d-7f6d-4651-8570-6b540b1aceee-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-617f007d-7f6d-4651-8570-6b540b1aceee-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "cinder-quobyte-617f007d-7f6d-4651-8570-6b540b1aceee" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-quobyte-617f007d-7f6d-4651-8570-6b540b1aceee" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ed064b-fd65-416b-8d64-9445abb67d1d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:29 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee Jun 23 12:51:29 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "cinder-cda468d2-2744-438c-90bf-3760fa7519e2-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:30 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.713s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:51:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Deleted volume successfully. Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-cda468d2-2744-438c-90bf-3760fa7519e2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4946231d-9801-42db-b53a-9a999da6b98f tempest-VolumesListTestJSON-976812368 None] Lock "cinder-8c820233-4562-4310-a316-3b6b254df0d6-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" acquired by "delete_volume" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ad939e-9612-4d1f-be81-85c72be63556]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:30 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 Jun 23 12:51:30 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:30 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee" returned: 0 in 0.819s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:30 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee Jun 23 12:51:30 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:30 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2" returned: 0 in 0.762s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:30 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2 Jun 23 12:51:30 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:31 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-617f007d-7f6d-4651-8570-6b540b1aceee" returned: 0 in 0.658s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-quobyte-617f007d-7f6d-4651-8570-6b540b1aceee" released by "delete_volume" :: held 1.527s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Created reservations ['a650986c-456f-432e-a467-53bd0d80cd41', '676797a1-3182-4d2b-8ec4-09d00843c8b3', 'e528f28d-38aa-4203-9f5b-175d4b624ee0', 'affa8c52-8152-4771-9265-bb6eb52d73ac'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:31 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:51:31 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:31 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-cda468d2-2744-438c-90bf-3760fa7519e2" returned: 0 in 0.653s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-quobyte-cda468d2-2744-438c-90bf-3760fa7519e2" released by "delete_volume" :: held 1.472s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Created reservations ['3fc9fada-2314-492f-8a33-8df22d6ad0b1', '842034f4-348d-45ce-a6a1-eb59e46a5b50', 'fcab0ac8-a90a-4d37-9e3a-247da3a73932', '657ef19c-9554-4da7-a8ef-c1ecc77c9f1a'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:31 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:51:31 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:32 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.679s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:32 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:51:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Deleted volume successfully. Jun 23 12:51:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-24b48441-d009-491f-9710-a83a2fe2cae7 tempest-VolumesListTestJSON-976812368 None] Lock "cinder-617f007d-7f6d-4651-8570-6b540b1aceee-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:32 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.736s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:32 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:51:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Deleted volume successfully. Jun 23 12:51:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-08e300df-999b-4884-a196-f519890df883 tempest-SnapshotsActionsTest-746487844 None] Lock "cinder-cda468d2-2744-438c-90bf-3760fa7519e2-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-125e45b9-796e-4c33-87a6-e056715f3a38 tempest-VolumesActionsTest-1514526071 None] Acquiring lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f" by "attach_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-125e45b9-796e-4c33-87a6-e056715f3a38 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f" acquired by "attach_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:37 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-125e45b9-796e-4c33-87a6-e056715f3a38 tempest-VolumesActionsTest-1514526071 None] Attaching volume 748e9d1d-b989-43cd-bf12-8ba2047ae06f to instance 2df5931f-e091-4d55-ad44-a26e2bec0f6c at mountpoint /dev/vdb on host None. Jun 23 12:51:37 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-125e45b9-796e-4c33-87a6-e056715f3a38 tempest-VolumesActionsTest-1514526071 None] Attach volume completed successfully. Jun 23 12:51:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-125e45b9-796e-4c33-87a6-e056715f3a38 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f" released by "attach_volume" :: held 0.168s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-395c905d-5c8b-4950-9992-4fe29b05d422 tempest-VolumesActionsTest-1514526071 None] Acquiring lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-detach_volume" by "detach_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-395c905d-5c8b-4950-9992-4fe29b05d422 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-395c905d-5c8b-4950-9992-4fe29b05d422 tempest-VolumesActionsTest-1514526071 None] Detaching volume 748e9d1d-b989-43cd-bf12-8ba2047ae06f from instance 2df5931f-e091-4d55-ad44-a26e2bec0f6c. Jun 23 12:51:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-395c905d-5c8b-4950-9992-4fe29b05d422 tempest-VolumesActionsTest-1514526071 None] Detach volume completed successfully. Jun 23 12:51:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-395c905d-5c8b-4950-9992-4fe29b05d422 tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Flow 'volume_create_manager' (ee700bff-f77d-49d6-9048-22fd9bc5f6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76f12ce-1b55-4b9c-bda6-bb8e6c13bbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76f12ce-1b55-4b9c-bda6-bb8e6c13bbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-807345727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88cdff1-0105-4750-90e3-6da427065291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdde49a59864598849c2ec0e6f89728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:40Z,use_quota=True,user_id='184a4cde6cec43dcae191c8e31dfb483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c93b960-a1bd-42e8-ae99-51458d848692),volume_type_id=3c93b960-a1bd-42e8-ae99-51458d848692)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f019f8-50b2-4dd5-881e-0b208aefbed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f019f8-50b2-4dd5-881e-0b208aefbed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946db76d-d7ad-4da4-a532-2112147e7142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (946db76d-d7ad-4da4-a532-2112147e7142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b88cdff1-0105-4750-90e3-6da427065291', 'volume_name': 'volume-b88cdff1-0105-4750-90e3-6da427065291', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd979dbb-14a1-481f-add2-704c3e34df9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd979dbb-14a1-481f-add2-704c3e34df9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d3629a-5219-4f4f-8e90-3053001a8aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:40 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Volume b88cdff1-0105-4750-90e3-6da427065291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b88cdff1-0105-4750-90e3-6da427065291', 'volume_size': 1} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-807345727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b88cdff1-0105-4750-90e3-6da427065291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fdde49a59864598849c2ec0e6f89728',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:51:40Z,use_quota=True,user_id='184a4cde6cec43dcae191c8e31dfb483',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c93b960-a1bd-42e8-ae99-51458d848692),volume_type_id=3c93b960-a1bd-42e8-ae99-51458d848692)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Creating volume b88cdff1-0105-4750-90e3-6da427065291 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:51:40 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:51:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:40 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 1073741824 Jun 23 12:51:40 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:41 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 1073741824" returned: 0 in 1.226s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:41 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 Jun 23 12:51:41 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:42 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291" returned: 0 in 0.758s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:51:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76d3629a-5219-4f4f-8e90-3053001a8aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b88cdff1-0105-4750-90e3-6da427065291', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b78faa-adde-4f25-874e-44f2bce1c983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:51:42 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Volume volume-b88cdff1-0105-4750-90e3-6da427065291 (b88cdff1-0105-4750-90e3-6da427065291): created successfully Jun 23 12:51:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b78faa-adde-4f25-874e-44f2bce1c983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:51:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Flow 'volume_create_manager' (ee700bff-f77d-49d6-9048-22fd9bc5f6a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:51:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-977fbbd7-25ad-4ca3-a4e3-f49fcfed0ade tempest-VolumeTypesAccessTest-830373109 None] Created volume successfully. Jun 23 12:51:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Acquiring lock "cinder-b88cdff1-0105-4750-90e3-6da427065291-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Lock "cinder-b88cdff1-0105-4750-90e3-6da427065291-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Acquiring lock "cinder-quobyte-b88cdff1-0105-4750-90e3-6da427065291" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:51:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Lock "cinder-quobyte-b88cdff1-0105-4750-90e3-6da427065291" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:51:43 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[34849a7c-1719-4692-b14b-1bf8da5ea94c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:43 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 Jun 23 12:51:43 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:44 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291" returned: 0 in 0.854s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:44 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291 Jun 23 12:51:44 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:45 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b88cdff1-0105-4750-90e3-6da427065291" returned: 0 in 0.652s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Lock "cinder-quobyte-b88cdff1-0105-4750-90e3-6da427065291" released by "delete_volume" :: held 1.564s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:45 devstack cinder-volume[93659]: WARNING cinder.quota [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1829472752 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1829472752, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:51:45 devstack cinder-volume[93659]: WARNING cinder.quota [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1829472752 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1829472752, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Created reservations ['a1cba75f-0178-4f4e-bdbc-42098734f02a', '36ab5c57-4bb0-48fb-bbce-b3101ec9a435', 'fa5d4b28-4f8a-4162-8493-8ac13beb9e1e', 'b27871f5-f280-4c00-ad6c-8510e88e95b3'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:51:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:45 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:51:45 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:46 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.759s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:46 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:51:46 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Deleted volume successfully. Jun 23 12:51:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f16165a2-48c8-4e45-a8b7-a079daa899b9 tempest-VolumeTypesAccessTest-830373109 None] Lock "cinder-b88cdff1-0105-4750-90e3-6da427065291-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:51:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:51:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:51:48 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0463bef-cca3-4ade-9519-5fe27ba9ef1c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:48 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:51:48 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:49 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 0.931s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:49 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[798e476c-e521-4529-9f22-a7bf373c1403]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:49 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:51:49 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:50 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 0.871s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.e952b2f6-cf2f-45f7-ad64-daf96153df7almrskrll.img {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:50 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.e952b2f6-cf2f-45f7-ad64-daf96153df7almrskrll.img Jun 23 12:51:50 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:56 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.e952b2f6-cf2f-45f7-ad64-daf96153df7almrskrll.img" returned: 0 in 5.765s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:56 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd6030a-eabf-43c6-b987-7b40f79b244e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:51:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:51:56 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:INSERT=22,cinder:SELECT=68,cinder:UPDATE=74,cinder:DELETE=7 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:51:56 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:51:56 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:51:57 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jun 23 12:51:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 1.323s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:51:57 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f, size 1024.00 MB, duration 5.77 sec, destination /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.e952b2f6-cf2f-45f7-ad64-daf96153df7almrskrll.img {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:51:57 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Converted 1024.00 MB image at 177.60 MB/s Jun 23 12:51:57 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] e952b2f6-cf2f-45f7-ad64-daf96153df7a was raw, no need to convert to raw {{(pid=93659) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Flow 'volume_create_manager' (b1967a0d-bacc-4d71-8fb8-699cfce76481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ea4d6f-2cc3-4f79-9c03-b5ffe46dadaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7ea4d6f-2cc3-4f79-9c03-b5ffe46dadaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-858370827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d6e7cea7f04979a05bdeb5bcdbd392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:05Z,use_quota=True,user_id='5e4854c560ac460aa890b0ef3bc2400c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34993176-d387-4df2-8d11-7bc62a7eae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34993176-d387-4df2-8d11-7bc62a7eae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda6a0f5-23ae-4c4f-bdfb-530ecf4a42cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda6a0f5-23ae-4c4f-bdfb-530ecf4a42cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f', 'volume_name': 'volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9151c12-d41c-4645-8410-720d6a8c86a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9151c12-d41c-4645-8410-720d6a8c86a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c625ba5-07ab-4794-824a-9047b43c3d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:05 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Volume 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 12:52:05 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Trying to clone 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 12:52:06 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 12:52:06 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Image download 20.69 MB at 20.69 MB/s Jun 23 12:52:06 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3e11c-8f19-4718-9dc5-d72e353ed219]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:06 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD Jun 23 12:52:06 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:07 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:07 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd is fetched for user 5e4854c560ac460aa890b0ef3bc2400c. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 12:52:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e297880-09b2-4967-9068-055dc75a4156]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:07 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD Jun 23 12:52:07 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:08 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD" returned: 0 in 0.919s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Flow 'volume_create_manager' (a05c7ce9-1105-4f7f-bc8a-088b482128cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b01d74-4ada-4419-9412-453ec4ab8d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4b01d74-4ada-4419-9412-453ec4ab8d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1678728138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c82019-3e58-4de1-afb3-8fb72fcd40e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8d389955b64df49ff88f70cb8576f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:10Z,use_quota=True,user_id='260bd8429634475185acb88602d986e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15db4b92-202a-44de-b61d-39d5e2a9af94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15db4b92-202a-44de-b61d-39d5e2a9af94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30afb36d-92d4-4226-81f9-8e5ba3af08ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30afb36d-92d4-4226-81f9-8e5ba3af08ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5c82019-3e58-4de1-afb3-8fb72fcd40e7', 'volume_name': 'volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837660b4-0bea-4fa4-9a91-c2f64cb907ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837660b4-0bea-4fa4-9a91-c2f64cb907ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a31d82-e7a9-4f1b-b821-e60658b28afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:09 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Volume f5c82019-3e58-4de1-afb3-8fb72fcd40e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7', 'volume_size': 1} Jun 23 12:52:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.986s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Uploaded volume to glance image-id: e952b2f6-cf2f-45f7-ad64-daf96153df7a. {{(pid=93659) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.131s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-858370827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d6e7cea7f04979a05bdeb5bcdbd392',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:05Z,use_quota=True,user_id='5e4854c560ac460aa890b0ef3bc2400c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Creating volume 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:52:19 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:52:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:19 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f 1073741824 Jun 23 12:52:19 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-79cf7b9c-154d-4342-a895-236301b7bc9a tempest-VolumesActionsTest-1514526071 None] Copy volume to image completed successfully. Jun 23 12:52:20 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f 1073741824" returned: 0 in 0.896s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:20 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:52:20 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:21 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 0 in 0.659s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.377s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1678728138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5c82019-3e58-4de1-afb3-8fb72fcd40e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8d389955b64df49ff88f70cb8576f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:10Z,use_quota=True,user_id='260bd8429634475185acb88602d986e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Creating volume f5c82019-3e58-4de1-afb3-8fb72fcd40e7 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:52:21 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:21 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 1073741824 Jun 23 12:52:21 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Attempting download of 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe583e2e-bca5-4121-a11d-859467be822e]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_puwcpd2h {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:21 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_puwcpd2h Jun 23 12:52:21 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:21 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:21 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 1073741824" returned: 0 in 0.828s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_puwcpd2h" returned: 0 in 0.750s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_puwcpd2h {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:22 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 Jun 23 12:52:22 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:22 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_puwcpd2h Jun 23 12:52:22 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:22 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:52:22 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:22 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7" returned: 0 in 0.665s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.657s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:22 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a31d82-e7a9-4f1b-b821-e60658b28afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934c810b-3abe-439f-9727-57d5225732e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf84562-ce8f-4b41-a1cc-5b86a25d6bab]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_puwcpd2h" returned: 1 in 0.754s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_puwcpd2h' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee61dc3b-23b4-4a43-88df-d325b225ecf4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:22 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Volume volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 (f5c82019-3e58-4de1-afb3-8fb72fcd40e7): created successfully Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934c810b-3abe-439f-9727-57d5225732e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Flow 'volume_create_manager' (a05c7ce9-1105-4f7f-bc8a-088b482128cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:22 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-cacf1e57-8b42-49be-be53-52e6358e3715 tempest-AbsoluteLimitsTests-974440373 None] Created volume successfully. Jun 23 12:52:22 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:52:22 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:22 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD Jun 23 12:52:22 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:22 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.690s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:52:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:52:23 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd was qcow2, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:23 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:52:23 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:23 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 0.859s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e462fd-f93d-4263-a349-a562ebb95f6e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Acquiring lock "cinder-f5c82019-3e58-4de1-afb3-8fb72fcd40e7-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Lock "cinder-f5c82019-3e58-4de1-afb3-8fb72fcd40e7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Acquiring lock "cinder-quobyte-f5c82019-3e58-4de1-afb3-8fb72fcd40e7" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Lock "cinder-quobyte-f5c82019-3e58-4de1-afb3-8fb72fcd40e7" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dfb433-0411-4538-82df-ce157182a6f6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:23 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:52:23 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:23 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 Jun 23 12:52:23 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:24 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 0.952s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:24 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img Jun 23 12:52:24 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:24 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7" returned: 0 in 0.904s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:24 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7 Jun 23 12:52:24 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:25 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f5c82019-3e58-4de1-afb3-8fb72fcd40e7" returned: 0 in 0.916s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Lock "cinder-quobyte-f5c82019-3e58-4de1-afb3-8fb72fcd40e7" released by "delete_volume" :: held 1.878s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=62,cinder:SELECT=49,cinder:INSERT=15,cinder:DELETE=2 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Created reservations ['76936f9d-786b-4d9f-8ff7-c05b217e5e33', 'b2694d95-9cb6-41df-a230-171f2d1d9a1b', '155a1a1b-cb23-47d4-a177-df4649313510', 'd5807525-62ff-40c9-a536-f180311319de'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:25 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:52:25 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:26 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 0 in 2.749s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:26 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_2h85pd1ydevstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:52:26 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Converted 112.00 MB image at 40.69 MB/s Jun 23 12:52:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:26 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f 1G Jun 23 12:52:26 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:27 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.922s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:27 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:52:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Deleted volume successfully. Jun 23 12:52:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-49d76a3d-d924-481d-bfdb-6cdb6e255859 tempest-AbsoluteLimitsTests-974440373 None] Lock "cinder-f5c82019-3e58-4de1-afb3-8fb72fcd40e7-delete_volume" released by "delete_volume" :: held 4.208s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:28 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f 1G" returned: 0 in 1.993s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:28 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aac4d63-f967-4b53-bb0e-1ef9e80f3e7e]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:28 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:52:28 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:30 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img" returned: 0 in 5.581s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:30 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a89d1-5b07-4644-b75f-78ef99994cad]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:30 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:52:30 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 0 in 2.031s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:30 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:30 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:52:30 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:31 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 1 in 0.773s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Downloaded image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd for user 5e4854c560ac460aa890b0ef3bc2400c is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Marking volume 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Copying metadata from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd to 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Creating volume glance metadata for volume 7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f backed by image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 12:52:31 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 1.118s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:52:31 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Converted 1024.00 MB image at 183.45 MB/s Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] ddd36907-dec3-4803-9eb4-045732b5c128 was raw, converting to qcow2 {{(pid=93659) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3998d002-db30-478f-a71a-116fdcd9c741]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c625ba5-07ab-4794-824a-9047b43c3d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbedaa8-3538-4bbf-b063-ef8c7b9f3aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:31 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Volume volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f (7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f): created successfully Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cbedaa8-3538-4bbf-b063-ef8c7b9f3aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:31 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Flow 'volume_create_manager' (b1967a0d-bacc-4d71-8fb8-699cfce76481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:31 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7270fef8-29de-4623-ac4a-38f2e9b78795 tempest-TestShelveInstance-1175577403 None] Created volume successfully. Jun 23 12:52:31 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img Jun 23 12:52:31 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:32 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img" returned: 0 in 0.861s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:32 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img Jun 23 12:52:32 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:32 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img" returned: 1 in 0.805s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:52:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img /opt/stack/data/cinder/conversion/vol_upload_60hh1pi2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:33 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img /opt/stack/data/cinder/conversion/vol_upload_60hh1pi2 Jun 23 12:52:33 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:33 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img /opt/stack/data/cinder/conversion/vol_upload_60hh1pi2" returned: 0 in 0.700s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:33 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Image conversion details: src /opt/stack/data/cinder/conversion/748e9d1d-b989-43cd-bf12-8ba2047ae06f.temp_image.ddd36907-dec3-4803-9eb4-045732b5c128qbdfo6w2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_60hh1pi2 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:52:33 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 23 12:52:33 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae64a001-95fb-452f-bd68-f612e76c5d79]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_60hh1pi2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:33 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_60hh1pi2 Jun 23 12:52:33 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:34 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_60hh1pi2" returned: 0 in 0.734s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:34 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Flow 'volume_create_manager' (59a6118e-e9ad-4459-9681-9f1ebf06821a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb24215-671d-449e-9dc0-69c08380d864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb24215-671d-449e-9dc0-69c08380d864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2104839945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2858915-9de6-4cf5-ae1f-042f47194d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54722917dc604294bb265846d0652089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:35Z,use_quota=True,user_id='cf07d80e9c2a43bd91da7df5b82215ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a9f170-8de1-4062-9ab9-7bf49bdb0713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a9f170-8de1-4062-9ab9-7bf49bdb0713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47270af-4208-49a9-85ee-7bb29ec9b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47270af-4208-49a9-85ee-7bb29ec9b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2858915-9de6-4cf5-ae1f-042f47194d08', 'volume_name': 'volume-e2858915-9de6-4cf5-ae1f-042f47194d08', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f800080-aed1-4a94-a82d-cd0a187d6d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f800080-aed1-4a94-a82d-cd0a187d6d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b86258-a775-416e-b558-869e807614f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:35 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Volume e2858915-9de6-4cf5-ae1f-042f47194d08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2858915-9de6-4cf5-ae1f-042f47194d08', 'volume_size': 1} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.122s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Uploaded volume to glance image-id: ddd36907-dec3-4803-9eb4-045732b5c128. {{(pid=93659) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.699s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2104839945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2858915-9de6-4cf5-ae1f-042f47194d08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54722917dc604294bb265846d0652089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:35Z,use_quota=True,user_id='cf07d80e9c2a43bd91da7df5b82215ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Creating volume e2858915-9de6-4cf5-ae1f-042f47194d08 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:52:35 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:52:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:35 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 1073741824 Jun 23 12:52:35 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-702ba62a-d87d-49a0-9d93-96b3a94f54ea tempest-VolumesActionsTest-1514526071 None] Copy volume to image completed successfully. Jun 23 12:52:36 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 1073741824" returned: 0 in 0.792s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:36 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 Jun 23 12:52:36 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:37 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08" returned: 0 in 0.664s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b86258-a775-416e-b558-869e807614f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2858915-9de6-4cf5-ae1f-042f47194d08', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d588117-ae4f-42bd-a465-de39b5293e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:37 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Volume volume-e2858915-9de6-4cf5-ae1f-042f47194d08 (e2858915-9de6-4cf5-ae1f-042f47194d08): created successfully Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d588117-ae4f-42bd-a465-de39b5293e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Flow 'volume_create_manager' (59a6118e-e9ad-4459-9681-9f1ebf06821a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:37 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0067e7ba-ce32-4986-bc58-9fc55a0959b6 tempest-VolumesTransfersV355Test-1830480470 None] Created volume successfully. Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Acquiring lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Acquiring lock "cinder-quobyte-748e9d1d-b989-43cd-bf12-8ba2047ae06f" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Lock "cinder-quobyte-748e9d1d-b989-43cd-bf12-8ba2047ae06f" acquired by "delete_volume" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77d2a58-4ecc-49a0-8ebb-0472a02b06bb]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:37 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:52:37 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:38 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:38 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f Jun 23 12:52:38 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f7a72437-6cb5-4086-8800-f11168599c55 tempest-VolumesTransfersV355Test-1621560771 None] Transfer volume completed successfully. Jun 23 12:52:39 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-748e9d1d-b989-43cd-bf12-8ba2047ae06f" returned: 0 in 0.820s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Lock "cinder-quobyte-748e9d1d-b989-43cd-bf12-8ba2047ae06f" released by "delete_volume" :: held 1.727s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Created reservations ['6a9d91c7-1d24-4b59-b868-aed9b81e9836', 'f28403aa-b777-46af-9259-b07e7297e316', '93897982-c469-4edc-a5f5-54393682557b', 'c0eaf2b3-d15e-4c94-85a9-c8bc378f6b79'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3333d6e7-c622-4d5c-ac8e-e1baf6ccdf5a]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:39 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:52:39 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:39 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:52:39 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Acquiring lock "cinder-e2858915-9de6-4cf5-ae1f-042f47194d08-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-e2858915-9de6-4cf5-ae1f-042f47194d08-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Acquiring lock "cinder-quobyte-e2858915-9de6-4cf5-ae1f-042f47194d08" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-quobyte-e2858915-9de6-4cf5-ae1f-042f47194d08" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[872cba5a-d061-4f37-a616-180b9c808f6c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:40 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.911s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:52:40 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 0 in 1.022s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Deleted volume successfully. Jun 23 12:52:40 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 Jun 23 12:52:40 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a09b57d6-1070-426a-bc59-f622b69cd6da tempest-VolumesActionsTest-1514526071 None] Lock "cinder-748e9d1d-b989-43cd-bf12-8ba2047ae06f-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:40 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:52:40 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:41 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08" returned: 0 in 0.958s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:41 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08 Jun 23 12:52:41 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:41 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 1 in 0.975s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.060s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb77f961-c293-48ef-beca-3b0ed58bd61a', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:52:41 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-82b446a2-32fc-4096-a042-a0e5849b03b9 req-f6ffa924-16a8-458d-84df-6ff0091c5915 tempest-TestShelveInstance-1175577403 None] attachment_update completed successfully. Jun 23 12:52:41 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e2858915-9de6-4cf5-ae1f-042f47194d08" returned: 0 in 0.719s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-quobyte-e2858915-9de6-4cf5-ae1f-042f47194d08" released by "delete_volume" :: held 1.742s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:41 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Created reservations ['33d75178-a99c-4cc6-889c-2233877522b7', 'bb5783aa-3252-436c-b4c3-babd4369cf10', '0eaabfd1-1a65-40f1-803d-f996df5468e3', '62cc1a08-6d63-4eeb-a065-210e5b050316'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:42 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:52:42 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:42 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.808s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:52:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Deleted volume successfully. Jun 23 12:52:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-21a779f6-76ed-49fb-b527-d222ec0ef1be tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-e2858915-9de6-4cf5-ae1f-042f47194d08-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Flow 'volume_create_manager' (1f1abc04-6933-43ab-8fe1-408a0b0e96f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e35f5f5-5cd4-40ae-943a-2ad10dd32a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e35f5f5-5cd4-40ae-943a-2ad10dd32a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1375971148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e640107-8ee4-490c-a686-c53be3ffc047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54722917dc604294bb265846d0652089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:43Z,use_quota=True,user_id='cf07d80e9c2a43bd91da7df5b82215ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897828b8-44dc-48bc-98fd-6d05d560c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897828b8-44dc-48bc-98fd-6d05d560c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb16e6f-420a-473b-a27c-b9d0c8ce48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb16e6f-420a-473b-a27c-b9d0c8ce48b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e640107-8ee4-490c-a686-c53be3ffc047', 'volume_name': 'volume-8e640107-8ee4-490c-a686-c53be3ffc047', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b00bd1-d8be-43b9-b1e3-6a3db2c653fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b00bd1-d8be-43b9-b1e3-6a3db2c653fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da08c2c0-0d2f-4ee2-aa85-6367c48c46d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:43 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Volume 8e640107-8ee4-490c-a686-c53be3ffc047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e640107-8ee4-490c-a686-c53be3ffc047', 'volume_size': 1} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1375971148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e640107-8ee4-490c-a686-c53be3ffc047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54722917dc604294bb265846d0652089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:43Z,use_quota=True,user_id='cf07d80e9c2a43bd91da7df5b82215ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Creating volume 8e640107-8ee4-490c-a686-c53be3ffc047 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:52:43 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:52:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:43 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 1073741824 Jun 23 12:52:43 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:44 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 1073741824" returned: 0 in 1.129s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:44 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 Jun 23 12:52:44 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:45 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047" returned: 0 in 0.721s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:52:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da08c2c0-0d2f-4ee2-aa85-6367c48c46d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e640107-8ee4-490c-a686-c53be3ffc047', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f1a2cd-9c09-40f4-b33e-3f47ecf1db1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:45 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Volume volume-8e640107-8ee4-490c-a686-c53be3ffc047 (8e640107-8ee4-490c-a686-c53be3ffc047): created successfully Jun 23 12:52:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f1a2cd-9c09-40f4-b33e-3f47ecf1db1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Flow 'volume_create_manager' (1f1abc04-6933-43ab-8fe1-408a0b0e96f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8c624ff9-2a3d-4c1c-9b32-0bad4e137cca tempest-VolumesTransfersV355Test-1830480470 None] Created volume successfully. Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Acquiring lock "cinder-8e640107-8ee4-490c-a686-c53be3ffc047-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-8e640107-8ee4-490c-a686-c53be3ffc047-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Acquiring lock "cinder-quobyte-8e640107-8ee4-490c-a686-c53be3ffc047" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-quobyte-8e640107-8ee4-490c-a686-c53be3ffc047" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b670f640-4020-45f8-bb8f-1fdc3c8d0d5e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:46 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 Jun 23 12:52:46 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (5c83b10f-173a-496a-8ee8-ed64bc656405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6439d7-bded-4cd6-a47b-1b2e5b1fd8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6439d7-bded-4cd6-a47b-1b2e5b1fd8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-783067051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee160e7-0b4b-4b10-bc1d-45f8865532c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:47Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffa123d-1779-4d5b-b295-4b99249cafae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffa123d-1779-4d5b-b295-4b99249cafae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b267761-9e43-453c-99a8-a2f942bd429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b267761-9e43-453c-99a8-a2f942bd429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee160e7-0b4b-4b10-bc1d-45f8865532c4', 'volume_name': 'volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f8cf56-61c7-4cbb-bfee-c8ccfecb2adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f8cf56-61c7-4cbb-bfee-c8ccfecb2adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849f894e-c64a-4cd8-8622-840b4d986ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:46 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Volume 9ee160e7-0b4b-4b10-bc1d-45f8865532c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4', 'volume_size': 1} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-783067051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee160e7-0b4b-4b10-bc1d-45f8865532c4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:47Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Creating volume 9ee160e7-0b4b-4b10-bc1d-45f8865532c4 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:52:47 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:52:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:47 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 1073741824 Jun 23 12:52:47 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:47 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047" returned: 0 in 1.163s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:47 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047 Jun 23 12:52:47 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:48 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 1073741824" returned: 0 in 1.488s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:48 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 Jun 23 12:52:48 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:48 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8e640107-8ee4-490c-a686-c53be3ffc047" returned: 0 in 0.892s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-quobyte-8e640107-8ee4-490c-a686-c53be3ffc047" released by "delete_volume" :: held 2.124s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:48 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Created reservations ['4579e1b8-9284-46e3-99fe-b5ef16cdcc46', '4ce178ed-49dc-451f-94b5-2beb9523be76', 'd55fe333-adbf-4632-bb07-d7c49af05c95', 'b45d8829-a8e1-4157-80ac-6d0a2ae8cf71'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:49 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:52:49 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:49 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4" returned: 0 in 0.684s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849f894e-c64a-4cd8-8622-840b4d986ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb89248-c6f9-403f-8219-699ed6cd7619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:49 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Volume volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 (9ee160e7-0b4b-4b10-bc1d-45f8865532c4): created successfully Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb89248-c6f9-403f-8219-699ed6cd7619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (5c83b10f-173a-496a-8ee8-ed64bc656405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:49 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e334e8ff-a1de-41c8-ba00-7e7b728a72b2 tempest-VolumesGetTest-2140741758 None] Created volume successfully. Jun 23 12:52:49 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.784s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:52:49 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Deleted volume successfully. Jun 23 12:52:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4fc1bebc-0e7e-4940-9764-3ccf83673299 tempest-VolumesTransfersV355Test-1895444703 None] Lock "cinder-8e640107-8ee4-490c-a686-c53be3ffc047-delete_volume" released by "delete_volume" :: held 3.226s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (7f7d5e78-3d63-452e-a2f0-5952ed8922c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660cc52b-6b3f-4352-ab2e-bc37284bc3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660cc52b-6b3f-4352-ab2e-bc37284bc3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2075442481',display_name='tempest-VolumesGetTest-Volume-93659277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b71b7ac-d93a-405a-b669-2ee60e895d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:51Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0662e543-805b-4ae3-98b5-c69f78ead603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0662e543-805b-4ae3-98b5-c69f78ead603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f370f-d5db-4e49-ac70-fe96c187d5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59f370f-d5db-4e49-ac70-fe96c187d5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b71b7ac-d93a-405a-b669-2ee60e895d9c', 'volume_name': 'volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb279722-266b-4309-90d2-92ba57a434a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb279722-266b-4309-90d2-92ba57a434a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1baf0f5-1d10-4fdd-b46e-812f33ac7432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:51 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Volume 7b71b7ac-d93a-405a-b669-2ee60e895d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c', 'volume_size': 1} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2075442481',display_name='tempest-VolumesGetTest-Volume-93659277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b71b7ac-d93a-405a-b669-2ee60e895d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:51Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Creating volume 7b71b7ac-d93a-405a-b669-2ee60e895d9c {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:52:51 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:52:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:51 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c 1073741824 Jun 23 12:52:51 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:52 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c 1073741824" returned: 0 in 1.398s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:52 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c Jun 23 12:52:52 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:53 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c" returned: 0 in 1.134s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] <== create_volume: return (2612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:52:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.619s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1baf0f5-1d10-4fdd-b46e-812f33ac7432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:53 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e165f45-851b-48fe-911b-2f4a40a65999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:54 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Volume volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c (7b71b7ac-d93a-405a-b669-2ee60e895d9c): created successfully Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e165f45-851b-48fe-911b-2f4a40a65999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (7f7d5e78-3d63-452e-a2f0-5952ed8922c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-dd512b68-6abb-4e9d-a8b4-4d94aed3bf4e tempest-VolumesGetTest-2140741758 None] Created volume successfully. Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-7b71b7ac-d93a-405a-b669-2ee60e895d9c-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Lock "cinder-7b71b7ac-d93a-405a-b669-2ee60e895d9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-7b71b7ac-d93a-405a-b669-2ee60e895d9c" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-7b71b7ac-d93a-405a-b669-2ee60e895d9c" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0dc112-8ded-400a-b068-5ad8e0a85c0c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:54 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c Jun 23 12:52:54 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:55 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c" returned: 0 in 1.036s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:55 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c Jun 23 12:52:55 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:56 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7b71b7ac-d93a-405a-b669-2ee60e895d9c" returned: 0 in 0.761s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-7b71b7ac-d93a-405a-b669-2ee60e895d9c" released by "delete_volume" :: held 1.881s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=52,cinder:UPDATE=51,cinder:INSERT=15,cinder:DELETE=6 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Created reservations ['6529c8c6-47e4-4d25-b897-1938d2d52fa6', 'f7510c1b-da6c-4fc3-a153-fabbd4843e79', '1fa13d26-26e5-44df-a967-fad3ced4900a', '2b9593d8-f42f-443a-b586-a780f74b0b94'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:56 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:52:56 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:56 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-9ee160e7-0b4b-4b10-bc1d-45f8865532c4-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Lock "cinder-9ee160e7-0b4b-4b10-bc1d-45f8865532c4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-9ee160e7-0b4b-4b10-bc1d-45f8865532c4" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-9ee160e7-0b4b-4b10-bc1d-45f8865532c4" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[631dc232-4e2d-4ca8-88e2-168bef4a87d1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:57 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 Jun 23 12:52:57 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Flow 'volume_create_manager' (c4077891-008d-4f17-b6aa-cc26a8de8ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56adae00-1719-431b-8d73-d35a25b61b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56adae00-1719-431b-8d73-d35a25b61b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-347977204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a93ae0d-6cf4-4936-8474-8dbde87403c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d72146bb8fc43f89dc7a6062c72dd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:58Z,use_quota=True,user_id='28c5054656a5460989d658d4586ad536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cc57f5-d330-4396-ae01-c2e31c55ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3cc57f5-d330-4396-ae01-c2e31c55ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87c33d7-1fcf-46af-95a1-a15b77a59b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87c33d7-1fcf-46af-95a1-a15b77a59b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a93ae0d-6cf4-4936-8474-8dbde87403c1', 'volume_name': 'volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab07621-8b4f-4455-adb6-abc024042e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab07621-8b4f-4455-adb6-abc024042e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179238d7-d9a6-4877-968b-da028876d6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:57 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Volume 8a93ae0d-6cf4-4936-8474-8dbde87403c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1', 'volume_size': 1} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-347977204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a93ae0d-6cf4-4936-8474-8dbde87403c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d72146bb8fc43f89dc7a6062c72dd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:52:58Z,use_quota=True,user_id='28c5054656a5460989d658d4586ad536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Creating volume 8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:57 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:52:57 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.970s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:52:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Deleted volume successfully. Jun 23 12:52:57 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 1073741824 Jun 23 12:52:57 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8b6e0a5-ebee-4320-b0b2-f1966984bb69 tempest-VolumesGetTest-2140741758 None] Lock "cinder-7b71b7ac-d93a-405a-b669-2ee60e895d9c-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:58 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4" returned: 0 in 1.064s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:58 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4 Jun 23 12:52:58 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:58 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 1073741824" returned: 0 in 0.888s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:58 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 Jun 23 12:52:58 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:58 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9ee160e7-0b4b-4b10-bc1d-45f8865532c4" returned: 0 in 0.691s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:58 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-9ee160e7-0b4b-4b10-bc1d-45f8865532c4" released by "delete_volume" :: held 1.818s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Created reservations ['49d95cbf-0d48-46fa-be59-4fbf0c22cd2d', 'e20402b5-4cbc-4f00-bcb6-7bd5a9230ea3', '44b8d002-2597-4d21-87bd-290e2afb481a', '991f766c-dbc7-4aaf-918b-e49a27f92563'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:52:59 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:52:59 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:52:59 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1" returned: 0 in 0.710s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179238d7-d9a6-4877-968b-da028876d6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46680433-e17c-4125-901d-74a8dc119b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:52:59 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Volume volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 (8a93ae0d-6cf4-4936-8474-8dbde87403c1): created successfully Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46680433-e17c-4125-901d-74a8dc119b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Flow 'volume_create_manager' (c4077891-008d-4f17-b6aa-cc26a8de8ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:52:59 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-897bbc0c-0cb9-4cb9-894e-46e098e571a2 tempest-VolumesCloneTest-1130813548 None] Created volume successfully. Jun 23 12:52:59 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.714s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:52:59 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Deleted volume successfully. Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8adb696-bc63-48e1-a307-c81b0ada3f7a tempest-VolumesGetTest-2140741758 None] Lock "cinder-9ee160e7-0b4b-4b10-bc1d-45f8865532c4-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:52:59 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (8633cb9d-0002-41e8-bdca-bf5094965540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376fa9c5-a0cf-494e-aba3-1b3baf19c2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (376fa9c5-a0cf-494e-aba3-1b3baf19c2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-696879429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4241191-3802-415b-aa57-471d91f03370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:00Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b4e358-c772-41e5-b329-9d53dcf9f31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21b4e358-c772-41e5-b329-9d53dcf9f31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667a7d68-1db1-44d1-bf46-977aa2f4c65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (667a7d68-1db1-44d1-bf46-977aa2f4c65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4241191-3802-415b-aa57-471d91f03370', 'volume_name': 'volume-f4241191-3802-415b-aa57-471d91f03370', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a49b73-6981-4737-9668-7bcd1e29dab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4a49b73-6981-4737-9668-7bcd1e29dab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae67430d-6cec-492f-b7d4-b3a89612a34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Volume f4241191-3802-415b-aa57-471d91f03370: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4241191-3802-415b-aa57-471d91f03370', 'volume_size': 1} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-696879429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4241191-3802-415b-aa57-471d91f03370,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:00Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Creating volume f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:53:00 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:00 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 1073741824 Jun 23 12:53:00 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Flow 'volume_create_manager' (04f4c894-247c-4149-8422-a92867fba0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c6d77c-933e-4b45-99ca-39b7be67d08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c6d77c-933e-4b45-99ca-39b7be67d08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1152620755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ae9e8e-fe37-4f08-aa8a-6a032212f2a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d72146bb8fc43f89dc7a6062c72dd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8a93ae0d-6cf4-4936-8474-8dbde87403c1,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:00Z,use_quota=True,user_id='28c5054656a5460989d658d4586ad536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb87a1c9-fa96-41d9-ab74-075e224f755d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb87a1c9-fa96-41d9-ab74-075e224f755d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7633710-2ff4-4bb5-b5bc-5af94f43e2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7633710-2ff4-4bb5-b5bc-5af94f43e2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '41ae9e8e-fe37-4f08-aa8a-6a032212f2a9', 'volume_name': 'volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9', 'volume_size': 2, 'source_volid': '8a93ae0d-6cf4-4936-8474-8dbde87403c1', 'source_volstatus': 'available'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5b7195-aa14-4489-86a8-80877efe1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b5b7195-aa14-4489-86a8-80877efe1168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2703b4d-d1d8-4f1d-a1af-e58aec9e903b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Volume 41ae9e8e-fe37-4f08-aa8a-6a032212f2a9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9', 'volume_size': 2, 'source_volid': '8a93ae0d-6cf4-4936-8474-8dbde87403c1', 'source_volstatus': 'available'} Jun 23 12:53:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:01 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 1073741824" returned: 0 in 0.947s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:01 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 Jun 23 12:53:01 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:01 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370" returned: 0 in 0.739s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.302s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:01 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Cloning volume 8a93ae0d-6cf4-4936-8474-8dbde87403c1 to volume 41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae67430d-6cec-492f-b7d4-b3a89612a34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4241191-3802-415b-aa57-471d91f03370', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee30246-119e-456f-bcdf-9f0a3f80e964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Creating offline snapshot d62003ae-9a72-4c9e-8233-a8bd48576f1e of volume 8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:53:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Volume volume-f4241191-3802-415b-aa57-471d91f03370 (f4241191-3802-415b-aa57-471d91f03370): created successfully Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ee30246-119e-456f-bcdf-9f0a3f80e964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (8633cb9d-0002-41e8-bdca-bf5094965540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c065f43-d0da-4306-8e0a-9b1b4c32062b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0b963aa8-44fc-442d-9628-28e7d87bce82 tempest-VolumesGetTest-2140741758 None] Created volume successfully. Jun 23 12:53:02 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 Jun 23 12:53:02 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:02 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1" returned: 0 in 0.737s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:02 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e 1G Jun 23 12:53:02 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:53:03 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e 1G" returned: 0 in 0.931s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:03 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e Jun 23 12:53:03 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (4a8dfea6-d0fe-413f-ab42-6812f296d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2315cd-7548-4c34-b59e-33ac94659cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2315cd-7548-4c34-b59e-33ac94659cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1720678618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f351a7ee-89a3-439a-a866-1de95be06600,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f4241191-3802-415b-aa57-471d91f03370,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:04Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ee461d-b83c-45d2-b797-193668a2bcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2ee461d-b83c-45d2-b797-193668a2bcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b06343b-b3c0-4c2c-bb7f-1e3932651cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b06343b-b3c0-4c2c-bb7f-1e3932651cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f351a7ee-89a3-439a-a866-1de95be06600', 'volume_name': 'volume-f351a7ee-89a3-439a-a866-1de95be06600', 'volume_size': 1, 'source_volid': 'f4241191-3802-415b-aa57-471d91f03370', 'source_volstatus': 'available'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5cedd7-5f5f-41fd-b967-0aa1c241cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5cedd7-5f5f-41fd-b967-0aa1c241cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358fdf08-a151-431b-8c7b-4d0e1eb551e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Volume f351a7ee-89a3-439a-a866-1de95be06600: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f351a7ee-89a3-439a-a866-1de95be06600', 'volume_size': 1, 'source_volid': 'f4241191-3802-415b-aa57-471d91f03370', 'source_volstatus': 'available'} Jun 23 12:53:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:04 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e" returned: 0 in 0.746s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:04 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e is being set with open permissions: ugo+rw Jun 23 12:53:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:04 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e Jun 23 12:53:04 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:05 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e" returned: 0 in 0.687s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:05 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.info Jun 23 12:53:05 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:05 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.info" returned: 0 in 0.621s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:05 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.info is being set with open permissions: ugo+rw Jun 23 12:53:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:05 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.info Jun 23 12:53:05 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:06 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.info" returned: 0 in 0.598s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "cinder-quobyte-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] snapshot: d62003ae-9a72-4c9e-8233-a8bd48576f1e, volume: 41ae9e8e-fe37-4f08-aa8a-6a032212f2a9, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af19214-d733-4fc1-9ba1-f68c3276f238]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:06 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e Jun 23 12:53:06 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:07 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e" returned: 0 in 0.742s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7746c2a9-1bea-4de3-9e48-6675a8883189]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:07 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 Jun 23 12:53:07 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:07 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1" returned: 0 in 0.730s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:53:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:07 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 Jun 23 12:53:07 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:12 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" returned: 0 in 4.644s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e578488-0758-4b17-bf0d-7f8d75205336]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:12 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 Jun 23 12:53:12 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:13 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1" returned: 0 in 0.929s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:13 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1, size 1024.00 MB, duration 4.65 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:53:13 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Converted 1024.00 MB image at 220.42 MB/s Jun 23 12:53:13 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 is being set with open permissions: ugo+rw Jun 23 12:53:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:13 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 Jun 23 12:53:13 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:14 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" returned: 0 in 0.641s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" released by "_copy_volume_from_snapshot" :: held 7.763s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "cinder-quobyte-d62003ae-9a72-4c9e-8233-a8bd48576f1e" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-d62003ae-9a72-4c9e-8233-a8bd48576f1e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Deleting offline snapshot d62003ae-9a72-4c9e-8233-a8bd48576f1e of volume 8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] snapshot_file for this snap is: volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d22042-9ea5-4911-91d2-7000904201a5]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:14 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e Jun 23 12:53:14 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:14 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e" returned: 0 in 0.821s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:53:15 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea02182-58ea-4a8c-9878-f7e409e779ad]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:15 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:INSERT=27,cinder:UPDATE=80,cinder:SELECT=59,cinder:DELETE=6 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:53:15 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 Jun 23 12:53:15 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:15 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1" returned: 0 in 0.753s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:15 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e Jun 23 12:53:15 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:16 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e" returned: 0 in 0.724s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:16 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e Jun 23 12:53:16 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:17 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1.d62003ae-9a72-4c9e-8233-a8bd48576f1e" returned: 0 in 0.800s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-d62003ae-9a72-4c9e-8233-a8bd48576f1e" released by "_delete_snapshot" :: held 3.229s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.576s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.656s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:17 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Cloning volume f4241191-3802-415b-aa57-471d91f03370 to volume f351a7ee-89a3-439a-a866-1de95be06600 Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2703b4d-d1d8-4f1d-a1af-e58aec9e903b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9', 'volume_size': 2, 'source_volid': '8a93ae0d-6cf4-4936-8474-8dbde87403c1', 'source_volstatus': 'available'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb00876b-1480-4e4b-a693-ab595947e24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:17 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Volume volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 (41ae9e8e-fe37-4f08-aa8a-6a032212f2a9): created successfully Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb00876b-1480-4e4b-a693-ab595947e24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Flow 'volume_create_manager' (04f4c894-247c-4149-8422-a92867fba0ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Creating offline snapshot 9b9cd664-8ac4-43f2-9cd2-72bcf8941222 of volume f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dfdc38-7bdd-4246-8e55-8538a7646165]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-74babde2-2b2c-4a07-b3e2-cd7e61a2aef4 tempest-VolumesCloneTest-1130813548 None] Created volume successfully. Jun 23 12:53:17 devstack sudo[107445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 Jun 23 12:53:17 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "cinder-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "cinder-quobyte-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c5ae8e-a3b2-4d04-82ad-4d1b01dcefd8]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:18 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 Jun 23 12:53:18 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:18 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370" returned: 0 in 0.854s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:18 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 1G Jun 23 12:53:18 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:18 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" returned: 0 in 0.804s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:19 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9 Jun 23 12:53:19 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:19 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 1G" returned: 0 in 0.859s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4241191-3802-415b-aa57-471d91f03370 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:19 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4241191-3802-415b-aa57-471d91f03370 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 Jun 23 12:53:19 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:19 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" returned: 0 in 0.773s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9" released by "delete_volume" :: held 1.640s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Created reservations ['8f396bf1-b231-4cd0-850e-ccd03dac9333', 'b549531a-56ab-48d0-af7e-6deba7270f11', '49e6e4af-5133-4fb9-9725-f908da731942', '25c101dc-da9d-413a-8cce-9302deece5b7'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:19 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4241191-3802-415b-aa57-471d91f03370 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222" returned: 0 in 0.750s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:19 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 is being set with open permissions: ugo+rw Jun 23 12:53:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:19 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:53:19 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:19 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 Jun 23 12:53:19 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Acquiring lock "cinder-8a93ae0d-6cf4-4936-8474-8dbde87403c1-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Lock "cinder-8a93ae0d-6cf4-4936-8474-8dbde87403c1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Acquiring lock "cinder-quobyte-8a93ae0d-6cf4-4936-8474-8dbde87403c1" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-8a93ae0d-6cf4-4936-8474-8dbde87403c1" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[781e1a53-84b8-4209-b0fe-7d35cec6cb1b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:20 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 Jun 23 12:53:20 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:20 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:20 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.829s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222" returned: 0 in 0.810s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:53:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Deleted volume successfully. Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-34f2f6af-f0e8-43a7-92d5-3919934f58f0 tempest-VolumesCloneTest-1130813548 None] Lock "cinder-41ae9e8e-fe37-4f08-aa8a-6a032212f2a9-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:20 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.info Jun 23 12:53:20 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:21 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-d3b587f7-fa35-4f09-a261-f0e437b865d4 req-a5509183-dc90-4c40-b35c-a6bb4ab3c286 tempest-TestShelveInstance-1175577403 None] Terminate volume connection completed successfully. Jun 23 12:53:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-d3b587f7-fa35-4f09-a261-f0e437b865d4 req-a5509183-dc90-4c40-b35c-a6bb4ab3c286 tempest-TestShelveInstance-1175577403 None] Deleting attachment cb77f961-c293-48ef-beca-3b0ed58bd61a. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:53:21 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1" returned: 0 in 0.836s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:21 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1 Jun 23 12:53:21 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:21 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.info" returned: 0 in 0.732s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:21 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.info is being set with open permissions: ugo+rw Jun 23 12:53:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:21 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.info Jun 23 12:53:21 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:22 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8a93ae0d-6cf4-4936-8474-8dbde87403c1" returned: 0 in 0.655s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Lock "cinder-quobyte-8a93ae0d-6cf4-4936-8474-8dbde87403c1" released by "delete_volume" :: held 1.567s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Created reservations ['fd000a46-6422-4829-b6f6-5dfa58653b93', 'ac4ed2c5-8f9d-4f40-8a8b-717f886c1b5c', 'b3cf3f3a-8ce8-4fdb-be6f-a93ec507bdd1', '386e191f-4ca6-4177-9995-32064973f2fa'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:53:22 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.info" returned: 0 in 0.674s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-f351a7ee-89a3-439a-a866-1de95be06600" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:22 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:53:22 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-f351a7ee-89a3-439a-a866-1de95be06600" acquired by "_copy_volume_from_snapshot" :: waited 0.077s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] snapshot: 9b9cd664-8ac4-43f2-9cd2-72bcf8941222, volume: f351a7ee-89a3-439a-a866-1de95be06600, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:53:22 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:53:22 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c25c70-0bbd-4773-bd6a-3a04e2cd038d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:22 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 Jun 23 12:53:22 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:23 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.944s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:53:23 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.950s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:53:23 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Deleted volume successfully. Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-3ad469fc-72c5-490f-b140-0f4a045a6e5f tempest-VolumesCloneTest-1130813548 None] Lock "cinder-8a93ae0d-6cf4-4936-8474-8dbde87403c1-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:23 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222" returned: 0 in 1.142s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4241191-3802-415b-aa57-471d91f03370(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[57daf6e8-c4cb-4efa-bb5f-7f5bc3e02764]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:23 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 Jun 23 12:53:23 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:24 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370" returned: 0 in 0.991s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:24 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:53:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:24 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 Jun 23 12:53:24 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Flow 'volume_create_manager' (8fd839ab-8e3c-4627-868f-e9ddc3ce6acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b01742-9464-4eaa-98de-ce725bc2675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b01742-9464-4eaa-98de-ce725bc2675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-452926380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20a5fa7-c519-499d-ba82-aa4320b39011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb82993324ec899fff0249e415298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:27Z,use_quota=True,user_id='c22a031e556f48cf9756dc2a939b2b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b293b9e5-3af5-4055-ad5f-db85c1827b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b293b9e5-3af5-4055-ad5f-db85c1827b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adb9abd-fa00-4217-a878-d127de91d5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adb9abd-fa00-4217-a878-d127de91d5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a20a5fa7-c519-499d-ba82-aa4320b39011', 'volume_name': 'volume-a20a5fa7-c519-499d-ba82-aa4320b39011', 'volume_size': 2}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6b8ed9-b87c-4b87-b464-cd4e7942fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6b8ed9-b87c-4b87-b464-cd4e7942fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfa89a6-b913-49d9-b3e7-6d82e9264c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Volume a20a5fa7-c519-499d-ba82-aa4320b39011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a20a5fa7-c519-499d-ba82-aa4320b39011', 'volume_size': 2} Jun 23 12:53:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:29 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600" returned: 0 in 5.309s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e3161a-0c99-4ed1-ad02-2a05ff9a4313]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:29 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 Jun 23 12:53:29 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:30 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370" returned: 0 in 0.904s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:30 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:53:30 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Converted 1024.00 MB image at 192.87 MB/s Jun 23 12:53:30 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 is being set with open permissions: ugo+rw Jun 23 12:53:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:30 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 Jun 23 12:53:30 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:31 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600" returned: 0 in 0.617s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-f351a7ee-89a3-439a-a866-1de95be06600" released by "_copy_volume_from_snapshot" :: held 9.064s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-9b9cd664-8ac4-43f2-9cd2-72bcf8941222" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-9b9cd664-8ac4-43f2-9cd2-72bcf8941222" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Deleting offline snapshot 9b9cd664-8ac4-43f2-9cd2-72bcf8941222 of volume f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] snapshot_file for this snap is: volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[538e0c45-2d98-4cb3-ac25-841a0dbed088]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:31 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 Jun 23 12:53:31 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:32 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222" returned: 0 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4241191-3802-415b-aa57-471d91f03370(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:53:32 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[514b8175-9535-403f-b7a8-b6aeea9c48be]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:32 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 Jun 23 12:53:32 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:32 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370" returned: 0 in 0.709s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:32 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 Jun 23 12:53:32 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:33 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222" returned: 0 in 0.748s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:33 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222 Jun 23 12:53:33 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:34 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370.9b9cd664-8ac4-43f2-9cd2-72bcf8941222" returned: 0 in 0.615s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-9b9cd664-8ac4-43f2-9cd2-72bcf8941222" released by "_delete_snapshot" :: held 2.889s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.934s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.103s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358fdf08-a151-431b-8c7b-4d0e1eb551e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f351a7ee-89a3-439a-a866-1de95be06600', 'volume_size': 1, 'source_volid': 'f4241191-3802-415b-aa57-471d91f03370', 'source_volstatus': 'available'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270185f7-6b10-4609-a96d-cd01c6a99de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:34 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Volume volume-f351a7ee-89a3-439a-a866-1de95be06600 (f351a7ee-89a3-439a-a866-1de95be06600): created successfully Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270185f7-6b10-4609-a96d-cd01c6a99de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (4a8dfea6-d0fe-413f-ab42-6812f296d274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4339389-4db4-4b43-b98d-d433d2db5e6d]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e24e5899-37a1-474b-a2cd-4244a6455621 tempest-VolumesGetTest-2140741758 None] Created volume successfully. Jun 23 12:53:34 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:53:34 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:35 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 0 in 0.818s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (6a904ab3-f5be-4e61-b0f7-46564da4bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ad31d9-e92f-44e1-8a6e-5df27d411e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:35 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:53:35 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ad31d9-e92f-44e1-8a6e-5df27d411e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-51163212',display_name='tempest-VolumesGetTest-Volume-1606360130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dccebd3-9293-432a-9a9b-8feec1479578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:35Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab5b040-2f02-4287-80ef-fb6f8279f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ab5b040-2f02-4287-80ef-fb6f8279f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaef63d-a477-4dc8-a310-346bb7025841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaef63d-a477-4dc8-a310-346bb7025841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dccebd3-9293-432a-9a9b-8feec1479578', 'volume_name': 'volume-4dccebd3-9293-432a-9a9b-8feec1479578', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e9732a-9190-4d5a-9d3c-a6150776c674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e9732a-9190-4d5a-9d3c-a6150776c674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c503038-1b9e-49c9-882a-4fa5b65eceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:35 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Volume 4dccebd3-9293-432a-9a9b-8feec1479578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dccebd3-9293-432a-9a9b-8feec1479578', 'volume_size': 1} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:35 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 1 in 0.778s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.655s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.170s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-452926380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a20a5fa7-c519-499d-ba82-aa4320b39011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e7eb82993324ec899fff0249e415298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:27Z,use_quota=True,user_id='c22a031e556f48cf9756dc2a939b2b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Creating volume a20a5fa7-c519-499d-ba82-aa4320b39011 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:53:36 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 2147483648 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:36 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 2147483648 Jun 23 12:53:36 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77728bfb-cd47-48df-a9be-693ecf2aed93', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:53:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-5308cf24-ddca-4a49-a8c8-9c9e8abafbdb req-70a86b13-208c-4b7b-9d74-e684575f2834 tempest-TestShelveInstance-1175577403 None] attachment_update completed successfully. Jun 23 12:53:36 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 2147483648" returned: 0 in 0.854s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:36 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 Jun 23 12:53:36 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:37 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011" returned: 0 in 0.629s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-51163212',display_name='tempest-VolumesGetTest-Volume-1606360130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dccebd3-9293-432a-9a9b-8feec1479578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:35Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Creating volume 4dccebd3-9293-432a-9a9b-8feec1479578 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:53:37 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:37 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 1073741824 Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bfa89a6-b913-49d9-b3e7-6d82e9264c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a20a5fa7-c519-499d-ba82-aa4320b39011', 'volume_size': 2}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:37 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dc1768-6989-41eb-9e88-ece15d455a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:37 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Volume volume-a20a5fa7-c519-499d-ba82-aa4320b39011 (a20a5fa7-c519-499d-ba82-aa4320b39011): created successfully Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4dc1768-6989-41eb-9e88-ece15d455a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Flow 'volume_create_manager' (8fd839ab-8e3c-4627-868f-e9ddc3ce6acf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:37 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-812b092f-3a43-405c-b9a6-01dd924b0f3a tempest-VolumesCloneNegativeTest-187974727 None] Created volume successfully. Jun 23 12:53:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Acquiring lock "cinder-a20a5fa7-c519-499d-ba82-aa4320b39011-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Lock "cinder-a20a5fa7-c519-499d-ba82-aa4320b39011-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Acquiring lock "cinder-quobyte-a20a5fa7-c519-499d-ba82-aa4320b39011" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Lock "cinder-quobyte-a20a5fa7-c519-499d-ba82-aa4320b39011" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcff02ac-3ea4-4d53-ba4d-2f29ed6a2582]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:38 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 Jun 23 12:53:38 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:38 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 1073741824" returned: 0 in 0.930s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:38 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 Jun 23 12:53:38 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:38 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011" returned: 0 in 0.807s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:38 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011 Jun 23 12:53:38 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:39 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578" returned: 0 in 0.629s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c503038-1b9e-49c9-882a-4fa5b65eceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dccebd3-9293-432a-9a9b-8feec1479578', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d26641-43bd-4dc7-97b7-2d1341cd9813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:39 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Volume volume-4dccebd3-9293-432a-9a9b-8feec1479578 (4dccebd3-9293-432a-9a9b-8feec1479578): created successfully Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d26641-43bd-4dc7-97b7-2d1341cd9813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (6a904ab3-f5be-4e61-b0f7-46564da4bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:39 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-16688940-4038-445a-8164-ed9dd75e3c49 tempest-VolumesGetTest-2140741758 None] Created volume successfully. Jun 23 12:53:39 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a20a5fa7-c519-499d-ba82-aa4320b39011" returned: 0 in 0.724s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-4dccebd3-9293-432a-9a9b-8feec1479578-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Lock "cinder-quobyte-a20a5fa7-c519-499d-ba82-aa4320b39011" released by "delete_volume" :: held 1.585s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Lock "cinder-4dccebd3-9293-432a-9a9b-8feec1479578-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-4dccebd3-9293-432a-9a9b-8feec1479578" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-4dccebd3-9293-432a-9a9b-8feec1479578" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Created reservations ['cebdcd34-994c-4619-9326-1e4c00a0a27a', '9ffe0f2a-c932-4c1e-b811-0c25f7b1644c', '639dcdc7-c1e2-4226-b6fc-6f8f372f951d', '4df8516a-5067-43f7-b271-6b251335b793'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf307343-96a5-476e-afcb-6c6c3b1ee9f7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:39 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:53:39 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:39 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 Jun 23 12:53:39 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:40 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.705s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:40 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:53:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Deleted volume successfully. Jun 23 12:53:40 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578" returned: 0 in 0.805s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fb1ccff6-05da-4377-a62a-5b3bea4f4f22 tempest-VolumesCloneNegativeTest-187974727 None] Lock "cinder-a20a5fa7-c519-499d-ba82-aa4320b39011-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:40 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578 Jun 23 12:53:40 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:41 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-4dccebd3-9293-432a-9a9b-8feec1479578" returned: 0 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-4dccebd3-9293-432a-9a9b-8feec1479578" released by "delete_volume" :: held 1.580s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Created reservations ['da49207b-5105-428c-ab6a-a8d27cbc7572', '24deb446-071e-4d08-ab44-7c164efdae32', 'bfcd2126-ad31-4bfb-b4b9-c3046c772c53', '3ef649df-e6dc-49f6-b609-a956938ecbdf'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:41 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:53:41 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-f351a7ee-89a3-439a-a866-1de95be06600-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Lock "cinder-f351a7ee-89a3-439a-a866-1de95be06600-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-f351a7ee-89a3-439a-a866-1de95be06600" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-f351a7ee-89a3-439a-a866-1de95be06600" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f139fa4-8419-4ee9-a77f-7dd45c09ef25]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:42 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 Jun 23 12:53:42 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:42 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.880s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:53:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Deleted volume successfully. Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-abc12411-267a-4ce1-a4ed-067af050926a tempest-VolumesGetTest-2140741758 None] Lock "cinder-4dccebd3-9293-432a-9a9b-8feec1479578-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:42 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600" returned: 0 in 0.800s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:42 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600 Jun 23 12:53:42 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:53:43 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Flow 'volume_create_manager' (04d8fa6a-0c57-4de8-8e20-efbefe7f5427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04292c7-c8a2-4673-99d1-581595a70297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f351a7ee-89a3-439a-a866-1de95be06600" returned: 0 in 0.724s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04292c7-c8a2-4673-99d1-581595a70297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-500323462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ecef0-1b07-4da5-a748-5ba59ba5485d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b6eda3f1e34bc085bd57b075f22393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:44Z,use_quota=True,user_id='6db082f120634e6a82e54c34fca45de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e003e4b-3951-4f80-98f8-eaa4219aa3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e003e4b-3951-4f80-98f8-eaa4219aa3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86135dcb-6d62-4def-8169-9f8a5a249a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86135dcb-6d62-4def-8169-9f8a5a249a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82ecef0-1b07-4da5-a748-5ba59ba5485d', 'volume_name': 'volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ef2cd6-c895-4698-b852-cc434bbc73e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ef2cd6-c895-4698-b852-cc434bbc73e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee89639-ad9d-4d5c-a810-5e1cc89345e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:43 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Volume f82ecef0-1b07-4da5-a748-5ba59ba5485d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d', 'volume_size': 1} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-500323462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82ecef0-1b07-4da5-a748-5ba59ba5485d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b6eda3f1e34bc085bd57b075f22393',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:44Z,use_quota=True,user_id='6db082f120634e6a82e54c34fca45de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Creating volume f82ecef0-1b07-4da5-a748-5ba59ba5485d {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:53:43 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-f351a7ee-89a3-439a-a866-1de95be06600" released by "delete_volume" :: held 1.631s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:43 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d 1073741824 Jun 23 12:53:43 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Created reservations ['1a8c25d5-9aaa-4ab8-8165-e7570e9c0a57', '13dbc1e4-b6a4-4738-b5dd-71c80a0a704c', '3a686e93-cd84-4a22-97f8-7350a39548cb', '405b14fe-b01a-4333-b8fc-621ddefe9edf'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:43 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:53:43 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-f4241191-3802-415b-aa57-471d91f03370-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Lock "cinder-f4241191-3802-415b-aa57-471d91f03370-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-f4241191-3802-415b-aa57-471d91f03370" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-f4241191-3802-415b-aa57-471d91f03370" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a64af79-fb5e-4c2c-93b9-4bd47e409e8e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:44 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 Jun 23 12:53:44 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:44 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d 1073741824" returned: 0 in 1.004s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:44 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.856s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:53:44 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Deleted volume successfully. Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-1720c4fb-07e0-4833-9920-29f2febbe326 tempest-VolumesGetTest-2140741758 None] Lock "cinder-f351a7ee-89a3-439a-a866-1de95be06600-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:44 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d Jun 23 12:53:44 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:45 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370" returned: 0 in 0.832s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:45 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370 Jun 23 12:53:45 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:45 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d" returned: 0 in 0.665s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee89639-ad9d-4d5c-a810-5e1cc89345e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad08b894-bdf2-465f-9461-f07cd93cddf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:45 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Volume volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d (f82ecef0-1b07-4da5-a748-5ba59ba5485d): created successfully Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad08b894-bdf2-465f-9461-f07cd93cddf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Flow 'volume_create_manager' (04d8fa6a-0c57-4de8-8e20-efbefe7f5427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4229dacd-82fb-425c-933d-1654cf681210 tempest-VolumesNegativeTest-1278293682 None] Created volume successfully. Jun 23 12:53:45 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f4241191-3802-415b-aa57-471d91f03370" returned: 0 in 0.658s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-f4241191-3802-415b-aa57-471d91f03370" released by "delete_volume" :: held 1.553s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Created reservations ['00810bfc-f263-47b4-855b-cb5b2fb1709f', '376c9b6a-61e7-4616-a827-d140fbe0c895', 'd1f75269-b00a-436b-9b69-cb0c2d789a42', '41ce6ebe-07a7-4701-bd58-14a1a58fa321'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:46 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:53:46 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:46 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.685s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:53:46 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Deleted volume successfully. Jun 23 12:53:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b639ab43-3149-42e0-af69-7ae4397204fc tempest-VolumesGetTest-2140741758 None] Lock "cinder-f4241191-3802-415b-aa57-471d91f03370-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (45b1144c-d1fe-48cf-a53d-29b54a1dfc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a3a59f-0a10-423e-b3c7-e444367a94d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70a3a59f-0a10-423e-b3c7-e444367a94d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-681294643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1a0def-5e22-4fd5-9e20-4e16276dec4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:47Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2da3736-8584-4943-8616-1c91614a8414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2da3736-8584-4943-8616-1c91614a8414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8df1ed-3187-4ca7-9a84-e63984c8a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:47 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8df1ed-3187-4ca7-9a84-e63984c8a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a1a0def-5e22-4fd5-9e20-4e16276dec4e', 'volume_name': 'volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0ab83c-b77e-4fe5-802d-06f90cc4a4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0ab83c-b77e-4fe5-802d-06f90cc4a4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab305ed8-1b80-4c14-bbec-4459f8299829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:48 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Volume 0a1a0def-5e22-4fd5-9e20-4e16276dec4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Trying to clone 0a1a0def-5e22-4fd5-9e20-4e16276dec4e from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 12:53:48 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Image download 20.69 MB at 20.69 MB/s Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a7a4c0-7cb9-459a-b141-38b687636e07]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:48 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD Jun 23 12:53:48 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:49 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD" returned: 0 in 0.745s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:49 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd is fetched for user a0c9af7ea16743c98acb191e1c1aa375. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 12:53:49 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c508897-0301-4e96-9a7a-ce5527a92878]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:49 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD Jun 23 12:53:49 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:50 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD" returned: 0 in 0.806s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-681294643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a1a0def-5e22-4fd5-9e20-4e16276dec4e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:53:47Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Creating volume 0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:53:50 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:53:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:50 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e 1073741824 Jun 23 12:53:50 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:51 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e 1073741824" returned: 0 in 1.062s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:51 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e Jun 23 12:53:51 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:52 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" returned: 0 in 0.841s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:53:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:53:52 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Attempting download of 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume 0a1a0def-5e22-4fd5-9e20-4e16276dec4e. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 12:53:52 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c0d570-c156-4c20-a56b-444e02d07ff2]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_lmk1kca7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:52 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_lmk1kca7 Jun 23 12:53:52 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:53 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_lmk1kca7" returned: 0 in 0.962s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_lmk1kca7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:53 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_lmk1kca7 Jun 23 12:53:53 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:54 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_lmk1kca7" returned: 1 in 0.948s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_lmk1kca7' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:53:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d75541-39d2-4605-9a3a-483fed23e5ca]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:54 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD Jun 23 12:53:54 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:55 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD" returned: 0 in 0.755s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:55 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd was qcow2, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 12:53:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:55 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e Jun 23 12:53:55 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:57 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" returned: 0 in 1.948s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:57 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57cbdffd-c41b-4a74-a7e1-52bf446cd7fd_wt9bipe7devstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:53:57 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Converted 112.00 MB image at 57.45 MB/s Jun 23 12:53:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:57 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e 1G Jun 23 12:53:57 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:57 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e 1G" returned: 0 in 0.705s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:57 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0545ca5f-3d6b-4126-a821-842987d355b1]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:53:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:58 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e Jun 23 12:53:58 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:58 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" returned: 0 in 0.778s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:53:58 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e Jun 23 12:53:58 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:53:59 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" returned: 1 in 0.878s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Downloaded image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd ((None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}])) to volume 0a1a0def-5e22-4fd5-9e20-4e16276dec4e successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Temporary image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd for user a0c9af7ea16743c98acb191e1c1aa375 is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Marking volume 0a1a0def-5e22-4fd5-9e20-4e16276dec4e as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Copying metadata from image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd to 0a1a0def-5e22-4fd5-9e20-4e16276dec4e. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Creating volume glance metadata for volume 0a1a0def-5e22-4fd5-9e20-4e16276dec4e backed by image 57cbdffd-c41b-4a74-a7e1-52bf446cd7fd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=67,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=21 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab305ed8-1b80-4c14-bbec-4459f8299829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e', 'volume_size': 1, 'image_id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '767d548e9ada4e7aa4eaf78d1c363a30', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57cbdffd-c41b-4a74-a7e1-52bf446cd7fd', 'created_at': datetime.datetime(2026, 6, 23, 10, 33, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 33, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57cbdffd-c41b-4a74-a7e1-52bf446cd7fd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a8fb05-7075-4106-872f-750deb755dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:53:59 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Volume volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e (0a1a0def-5e22-4fd5-9e20-4e16276dec4e): created successfully Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a8fb05-7075-4106-872f-750deb755dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:53:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (45b1144c-d1fe-48cf-a53d-29b54a1dfc9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:53:59 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-95d49e23-efd4-40fe-b4cc-3d88c9245148 tempest-VolumesGetTest-2140741758 None] Created volume successfully. Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (021f0c45-4165-4ebe-be0f-e87910baf0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d187a3-05cc-4700-92a4-2a251de40828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d187a3-05cc-4700-92a4-2a251de40828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2017137331',display_name='tempest-VolumesGetTest-Volume-1370738973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:02Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e233b009-da2f-4470-80cc-8adcb494b6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e233b009-da2f-4470-80cc-8adcb494b6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917c8e40-84e9-4123-b795-b8e1e484435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917c8e40-84e9-4123-b795-b8e1e484435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd', 'volume_name': 'volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be170b1d-7d66-47d0-a55c-1668771289ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be170b1d-7d66-47d0-a55c-1668771289ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4daf95-4a1d-4b33-be21-154aa1a66736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Volume ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd', 'volume_size': 1} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2017137331',display_name='tempest-VolumesGetTest-Volume-1370738973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a90deb04346c44528f71096cb21eae88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:02Z,use_quota=True,user_id='a0c9af7ea16743c98acb191e1c1aa375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Creating volume ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:54:01 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:54:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:01 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd 1073741824 Jun 23 12:54:01 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:02 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd 1073741824" returned: 0 in 1.154s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:02 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd Jun 23 12:54:02 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:03 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd" returned: 0 in 0.760s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] <== create_volume: return (1973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:54:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4daf95-4a1d-4b33-be21-154aa1a66736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172973e9-b4d2-4593-b88f-73a433076779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Volume volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd (ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd): created successfully Jun 23 12:54:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172973e9-b4d2-4593-b88f-73a433076779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Flow 'volume_create_manager' (021f0c45-4165-4ebe-be0f-e87910baf0a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ba60b6a8-a095-4737-bfc0-2be5f82d90aa tempest-VolumesGetTest-2140741758 None] Created volume successfully. Jun 23 12:54:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Lock "cinder-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:05 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[038399df-4903-49e3-b311-e8498774847e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:05 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd Jun 23 12:54:05 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:05 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd" returned: 0 in 0.924s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:05 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd Jun 23 12:54:05 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:06 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd" returned: 0 in 0.640s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd" released by "delete_volume" :: held 1.617s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Created reservations ['377598c1-2a4c-4ba9-b570-c2b0c8da1276', '1ab27730-2b3c-449e-ba93-bfe8ef1ddacb', '6f71d0df-235e-4e16-b817-18b45553f564', '58f503a2-2e78-4f6f-82a4-3eaf2c4a15d7'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:06 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:54:06 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-0a1a0def-5e22-4fd5-9e20-4e16276dec4e-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Lock "cinder-0a1a0def-5e22-4fd5-9e20-4e16276dec4e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Acquiring lock "cinder-quobyte-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51458bd-2234-4ba3-99dd-4663f74f460f]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:07 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.781s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:54:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Deleted volume successfully. Jun 23 12:54:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d65d4dde-018d-4ccf-9cb4-713f36fc9a67 tempest-VolumesGetTest-2140741758 None] Lock "cinder-ab52f73b-bbce-4d3a-9c7c-a61bb8f213cd-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:07 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e Jun 23 12:54:07 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:08 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" returned: 0 in 0.755s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:08 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e Jun 23 12:54:08 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:08 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" returned: 1 in 0.763s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:54:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:09 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e Jun 23 12:54:09 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:09 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" returned: 0 in 0.666s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Lock "cinder-quobyte-0a1a0def-5e22-4fd5-9e20-4e16276dec4e" released by "delete_volume" :: held 2.244s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Created reservations ['20ba7758-3be4-42b1-a83c-284acc26718a', '82fe747e-0b57-4fac-ac38-a271545f3ca1', '957b42a5-17cf-4643-9cc0-8fdafb5a8385', '02aa3c32-0996-4c98-bc90-f32bcaf9b177'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:09 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:54:09 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:10 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.711s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:10 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:54:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Deleted volume successfully. Jun 23 12:54:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bd595085-0de9-4f0e-8468-d53538c14efc tempest-VolumesGetTest-2140741758 None] Lock "cinder-0a1a0def-5e22-4fd5-9e20-4e16276dec4e-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Acquiring lock "cinder-f82ecef0-1b07-4da5-a748-5ba59ba5485d-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Lock "cinder-f82ecef0-1b07-4da5-a748-5ba59ba5485d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=93,cinder:INSERT=31,cinder:SELECT=74,cinder:DELETE=7 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Acquiring lock "cinder-quobyte-f82ecef0-1b07-4da5-a748-5ba59ba5485d" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Lock "cinder-quobyte-f82ecef0-1b07-4da5-a748-5ba59ba5485d" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c26f51a-6e8b-4eb6-8876-d01eb9dea68f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:18 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d Jun 23 12:54:18 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:18 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d" returned: 0 in 0.763s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:18 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d Jun 23 12:54:18 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:19 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f82ecef0-1b07-4da5-a748-5ba59ba5485d" returned: 0 in 0.720s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Lock "cinder-quobyte-f82ecef0-1b07-4da5-a748-5ba59ba5485d" released by "delete_volume" :: held 1.539s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Created reservations ['a5189b2e-db70-477e-bdc8-08ecfe080993', '0c94515d-1fc5-4a84-9b4b-43cc035ef7bb', '2506b1c5-3fda-45c6-b743-0f15d871ff6a', 'd5d52d75-3d6b-4533-8cca-0472c5863908'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:19 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:54:19 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:20 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.725s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:20 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:54:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Deleted volume successfully. Jun 23 12:54:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-dc4c2353-b0fb-4550-abfb-a1db72a904bf tempest-VolumesNegativeTest-1278293682 None] Lock "cinder-f82ecef0-1b07-4da5-a748-5ba59ba5485d-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:54:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:22 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:54:22 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:23 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.753s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:54:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:54:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:54:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (4012a9bc-9be5-4f7c-8d69-38722b2c5cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f65892f-99eb-4834-baf1-eddc2f7d8eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f65892f-99eb-4834-baf1-eddc2f7d8eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-694351885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25089b77-c93f-477e-ab23-aa2a02afb37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:26Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5978c44-529e-4b0d-b618-2cfa48ded034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5978c44-529e-4b0d-b618-2cfa48ded034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d08192-c307-4417-8c29-1bc24f3af9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d08192-c307-4417-8c29-1bc24f3af9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25089b77-c93f-477e-ab23-aa2a02afb37c', 'volume_name': 'volume-25089b77-c93f-477e-ab23-aa2a02afb37c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb50c0c0-f449-4ea5-8b20-d6f15e1bfdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb50c0c0-f449-4ea5-8b20-d6f15e1bfdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905a3c96-dccf-498d-acbf-71c949605708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:25 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Volume 25089b77-c93f-477e-ab23-aa2a02afb37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25089b77-c93f-477e-ab23-aa2a02afb37c', 'volume_size': 1} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-694351885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25089b77-c93f-477e-ab23-aa2a02afb37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:26Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Creating volume 25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:54:25 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:54:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:25 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c 1073741824 Jun 23 12:54:25 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:26 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c 1073741824" returned: 0 in 1.039s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:26 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c Jun 23 12:54:26 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:27 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c" returned: 0 in 1.092s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:54:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (905a3c96-dccf-498d-acbf-71c949605708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25089b77-c93f-477e-ab23-aa2a02afb37c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6f98dd-6f4c-4cb9-92eb-c5723c2c7706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Volume volume-25089b77-c93f-477e-ab23-aa2a02afb37c (25089b77-c93f-477e-ab23-aa2a02afb37c): created successfully Jun 23 12:54:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6f98dd-6f4c-4cb9-92eb-c5723c2c7706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (4012a9bc-9be5-4f7c-8d69-38722b2c5cbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-caaf4782-a71d-4e31-991d-d5d198b97d4b tempest-VolumesSnapshotTestJSON-222993235 None] Created volume successfully. Jun 23 12:54:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Creating offline snapshot ac396757-251d-4dd3-b27f-dab81e6c23ea of volume 25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:54:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92178ac-8ea0-4e8f-b5b9-e4a550c0b320]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:29 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c Jun 23 12:54:29 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:30 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c" returned: 0 in 0.863s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:30 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea 1G Jun 23 12:54:30 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:31 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea 1G" returned: 0 in 1.026s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25089b77-c93f-477e-ab23-aa2a02afb37c -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:31 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25089b77-c93f-477e-ab23-aa2a02afb37c -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea Jun 23 12:54:31 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:32 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25089b77-c93f-477e-ab23-aa2a02afb37c -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea" returned: 0 in 1.006s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:32 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea is being set with open permissions: ugo+rw Jun 23 12:54:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:32 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea Jun 23 12:54:32 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:33 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea" returned: 0 in 0.817s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:33 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.info Jun 23 12:54:33 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:33 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-ff9f1ede-afdc-4c12-bea9-be9b21b24337 tempest-TestShelveInstance-1175577403 None] Terminate volume connection completed successfully. Jun 23 12:54:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-ff9f1ede-afdc-4c12-bea9-be9b21b24337 tempest-TestShelveInstance-1175577403 None] Deleting attachment 77728bfb-cd47-48df-a9be-693ecf2aed93. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:54:34 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.info" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:34 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.info is being set with open permissions: ugo+rw Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:34 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.info Jun 23 12:54:34 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Acquiring lock "cinder-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Lock "cinder-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Acquiring lock "cinder-quobyte-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Lock "cinder-quobyte-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cec2be-9451-48d9-8ea7-f1c66914c798]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:34 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:54:34 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:34 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.info" returned: 0 in 0.848s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.560s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8c19165b-d334-4622-8935-50da41f01e30 tempest-VolumesSnapshotTestJSON-222993235 None] Create snapshot completed successfully Jun 23 12:54:35 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 0 in 0.840s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:35 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:54:35 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-ac396757-251d-4dd3-b27f-dab81e6c23ea-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-ac396757-251d-4dd3-b27f-dab81e6c23ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-25089b77-c93f-477e-ab23-aa2a02afb37c" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-25089b77-c93f-477e-ab23-aa2a02afb37c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-ac396757-251d-4dd3-b27f-dab81e6c23ea" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-ac396757-251d-4dd3-b27f-dab81e6c23ea" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Deleting offline snapshot ac396757-251d-4dd3-b27f-dab81e6c23ea of volume 25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:54:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] snapshot_file for this snap is: volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:54:36 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debc59e-0f7c-4753-a1c0-bb9d84044765]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:36 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 1 in 0.973s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:54:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:36 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f Jun 23 12:54:36 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:36 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea Jun 23 12:54:36 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:37 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea" returned: 0 in 1.124s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25089b77-c93f-477e-ab23-aa2a02afb37c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:54:37 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" returned: 0 in 1.060s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ba911d-7e7d-4162-acd2-3ad94fb91fdc]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Lock "cinder-quobyte-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f" released by "delete_volume" :: held 2.967s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG cinder.quota [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Created reservations ['45fd51f5-1c0a-49c0-bb8a-cbb22a066c7c', '4b5ac1c4-fa77-4c76-8c7a-c4266711f87d', 'b60052f4-3da3-4613-9d77-23600d98990c', 'b7a7e7ab-f6ae-40cc-a702-f286689bdf83'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:54:37 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c Jun 23 12:54:37 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:37 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:54:37 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:38 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c" returned: 0 in 1.014s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:38 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.845s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:38 devstack cinder-volume[93659]: DEBUG cinder.manager [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:54:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Deleted volume successfully. Jun 23 12:54:38 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea Jun 23 12:54:38 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [req-5f51dd09-9683-401e-9206-ec0d387ecdc4 req-7721aeb8-3d11-4b39-a61f-60d1cd67f767 tempest-TestShelveInstance-1175577403 None] Lock "cinder-7d4bf6b0-c35f-4a8c-a743-5ad473b27a8f-delete_volume" released by "delete_volume" :: held 4.175s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:39 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea" returned: 0 in 0.940s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:39 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea Jun 23 12:54:39 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:39 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c.ac396757-251d-4dd3-b27f-dab81e6c23ea" returned: 0 in 0.786s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-ac396757-251d-4dd3-b27f-dab81e6c23ea" released by "_delete_snapshot" :: held 4.015s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-25089b77-c93f-477e-ab23-aa2a02afb37c" released by "delete_snapshot" :: held 4.047s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:40 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['e7f3865e-4dd6-4114-8ab8-6a7f1095b031', '8f1b3dc5-d493-44ab-a888-784e88d140c2', '4bc94b53-c60b-47fb-ab51-49903059d440', '7089459a-08f7-4342-a67a-6d1074cac4df'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:54:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Delete snapshot completed successfully. Jun 23 12:54:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9b482b04-5ae4-402f-87d2-bedc2a823fa0 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-ac396757-251d-4dd3-b27f-dab81e6c23ea-delete_snapshot" released by "delete_snapshot" :: held 4.285s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (457dece1-15c7-4d9f-ad86-f51c40f3d780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a20a6c1-9268-42c3-8d6f-82bd3dffcc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a20a6c1-9268-42c3-8d6f-82bd3dffcc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-238499314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c8e8b7-7568-45b3-910e-2dcec95ffc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:42Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1da6bc0-d381-43af-af02-f604468196e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1da6bc0-d381-43af-af02-f604468196e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709ea55a-ab66-4896-ba18-551ba8191ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709ea55a-ab66-4896-ba18-551ba8191ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59c8e8b7-7568-45b3-910e-2dcec95ffc89', 'volume_name': 'volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da17938-ea1b-401b-bc51-1a98f1c6d3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da17938-ea1b-401b-bc51-1a98f1c6d3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdd1c05-eaba-47af-bd31-4f113e6c2e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:41 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Volume 59c8e8b7-7568-45b3-910e-2dcec95ffc89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89', 'volume_size': 1} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-238499314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59c8e8b7-7568-45b3-910e-2dcec95ffc89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:42Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Creating volume 59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:54:41 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:54:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:42 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 1073741824 Jun 23 12:54:42 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:43 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 1073741824" returned: 0 in 1.134s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:43 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 Jun 23 12:54:43 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:43 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89" returned: 0 in 0.750s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:54:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.983s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdd1c05-eaba-47af-bd31-4f113e6c2e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:43 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c33ce8-aa85-4fa5-8eab-bece88b87c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:43 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Volume volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 (59c8e8b7-7568-45b3-910e-2dcec95ffc89): created successfully Jun 23 12:54:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c33ce8-aa85-4fa5-8eab-bece88b87c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (457dece1-15c7-4d9f-ad86-f51c40f3d780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:44 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d5be33d1-afe2-494e-b717-88eea005f6c3 tempest-VolumesSnapshotTestJSON-222993235 None] Created volume successfully. Jun 23 12:54:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Creating offline snapshot eefb3c29-0232-4b26-9fea-9abecf59590c of volume 59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:54:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b7ee22-4415-4cd7-a311-0a5acbc063a4]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:45 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 Jun 23 12:54:45 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:46 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89" returned: 0 in 0.876s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:46 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c 1G Jun 23 12:54:46 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:47 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c 1G" returned: 0 in 0.898s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:47 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c Jun 23 12:54:47 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:47 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c" returned: 0 in 0.823s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:47 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c is being set with open permissions: ugo+rw Jun 23 12:54:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:47 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c Jun 23 12:54:47 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:48 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c" returned: 0 in 0.841s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:48 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.info Jun 23 12:54:48 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Flow 'volume_create_manager' (a8ce6c34-34a4-40b9-bb09-6d9f77580893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c4a892-f953-44fb-ae94-75c98425710f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c4a892-f953-44fb-ae94-75c98425710f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1778613826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941c4d81-6952-4679-bbd7-c804aaa13789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef70c39096478f9f4e8b4d54a50341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:49Z,use_quota=True,user_id='49ffd658e25b4198afb4b5381dd90111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0298893f-88ee-4129-8286-03bdf87a7c4f),volume_type_id=0298893f-88ee-4129-8286-03bdf87a7c4f)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6efc5b-44a0-4fcd-ae7b-5a2423f206b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e6efc5b-44a0-4fcd-ae7b-5a2423f206b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0ac667-dd78-4fc3-886e-7861f8994b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0ac667-dd78-4fc3-886e-7861f8994b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941c4d81-6952-4679-bbd7-c804aaa13789', 'volume_name': 'volume-941c4d81-6952-4679-bbd7-c804aaa13789', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9410df2e-d915-483e-aff0-d7d743c2e4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9410df2e-d915-483e-aff0-d7d743c2e4c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2a8da6-048c-49a1-a3c8-4e392e405760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume 941c4d81-6952-4679-bbd7-c804aaa13789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941c4d81-6952-4679-bbd7-c804aaa13789', 'volume_size': 1} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:49 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.info" returned: 0 in 0.928s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:49 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.info is being set with open permissions: ugo+rw Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:49 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.info Jun 23 12:54:49 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Flow 'volume_create_manager' (9622f073-a44c-4124-9e18-1b1c25fa3cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bd5b6c-4fa8-4f08-a1c5-265425808f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bd5b6c-4fa8-4f08-a1c5-265425808f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-362653951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef70c39096478f9f4e8b4d54a50341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:50Z,use_quota=True,user_id='49ffd658e25b4198afb4b5381dd90111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(053b63a9-cffe-4e46-a2fa-a7995bcd54e1),volume_type_id=053b63a9-cffe-4e46-a2fa-a7995bcd54e1)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30669478-faaa-4b32-af0b-75128c23f00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30669478-faaa-4b32-af0b-75128c23f00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a5d4b-93fd-495d-9199-1e4f9c21a9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312a5d4b-93fd-495d-9199-1e4f9c21a9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63', 'volume_name': 'volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497b5b8e-b596-49fd-90b5-40aeb0514bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497b5b8e-b596-49fd-90b5-40aeb0514bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b7b7a2-977e-424c-8c39-e332617a6967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:49 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume 3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63', 'volume_size': 1} Jun 23 12:54:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:50 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.info" returned: 0 in 0.824s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.316s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.055s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1778613826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941c4d81-6952-4679-bbd7-c804aaa13789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef70c39096478f9f4e8b4d54a50341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:49Z,use_quota=True,user_id='49ffd658e25b4198afb4b5381dd90111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0298893f-88ee-4129-8286-03bdf87a7c4f),volume_type_id=0298893f-88ee-4129-8286-03bdf87a7c4f)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Creating volume 941c4d81-6952-4679-bbd7-c804aaa13789 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:54:50 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:50 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 1073741824 Jun 23 12:54:50 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Flow 'volume_create_manager' (4c8d8308-9fd2-4b29-9113-e605fe60f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c2c82-f651-4cf3-9791-2879c1bab7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f440bc2e-7cf8-4c86-9628-3a94fcc9ea54 tempest-VolumesSnapshotTestJSON-222993235 None] Create snapshot completed successfully Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a6c2c82-f651-4cf3-9791-2879c1bab7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094762175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae694e72-149a-407e-b126-8a01a75767cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef70c39096478f9f4e8b4d54a50341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:51Z,use_quota=True,user_id='49ffd658e25b4198afb4b5381dd90111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(890e32c5-020e-44f5-9697-f88c2387f577),volume_type_id=890e32c5-020e-44f5-9697-f88c2387f577)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2d1514-8845-4a8f-8b80-1c8ca70d9db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac2d1514-8845-4a8f-8b80-1c8ca70d9db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0b4ba8-ab60-4848-a591-818a58d1ca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:50 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 12:54:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0b4ba8-ab60-4848-a591-818a58d1ca9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae694e72-149a-407e-b126-8a01a75767cf', 'volume_name': 'volume-ae694e72-149a-407e-b126-8a01a75767cf', 'volume_size': 1, 'image_id': 'bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--397129212', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77ef70c39096478f9f4e8b4d54a50341', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'created_at': datetime.datetime(2026, 6, 23, 10, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 54, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3/file', 'properties': {}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b79d4d-e4d7-483c-a64e-d7cb2da2bf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b79d4d-e4d7-483c-a64e-d7cb2da2bf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:51 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe668a9a-1eca-49cb-871e-9b85dfa67eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:51 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume ae694e72-149a-407e-b126-8a01a75767cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae694e72-149a-407e-b126-8a01a75767cf', 'volume_size': 1, 'image_id': 'bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--397129212', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77ef70c39096478f9f4e8b4d54a50341', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'created_at': datetime.datetime(2026, 6, 23, 10, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 54, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3/file', 'properties': {}}, 'image_service': } Jun 23 12:54:51 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Trying to clone ae694e72-149a-407e-b126-8a01a75767cf from image bf7a5025-39fa-45d3-b8b9-552cb57845a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 12:54:51 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 1073741824" returned: 0 in 1.099s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:51 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 Jun 23 12:54:51 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (e6e93d4e-a5d3-4410-9454-2fcdc7007294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483898a9-b667-4454-a020-c928b3a20be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483898a9-b667-4454-a020-c928b3a20be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-902360032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb88122f-96c4-456c-946b-f64c45419971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=eefb3c29-0232-4b26-9fea-9abecf59590c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:52Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408578aa-a0fa-416a-ad18-a0da3cc9b067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (408578aa-a0fa-416a-ad18-a0da3cc9b067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6849af7-0c90-4912-a7d1-90c327b58fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6849af7-0c90-4912-a7d1-90c327b58fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bb88122f-96c4-456c-946b-f64c45419971', 'volume_name': 'volume-bb88122f-96c4-456c-946b-f64c45419971', 'volume_size': 2, 'snapshot_id': 'eefb3c29-0232-4b26-9fea-9abecf59590c'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf90d712-9839-40a0-9a5a-543f0c3341d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf90d712-9839-40a0-9a5a-543f0c3341d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc054533-ac52-4d1c-b42e-e5a9fd8a0633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:52 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Volume bb88122f-96c4-456c-946b-f64c45419971: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bb88122f-96c4-456c-946b-f64c45419971', 'volume_size': 2, 'snapshot_id': 'eefb3c29-0232-4b26-9fea-9abecf59590c'} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:52 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789" returned: 0 in 0.721s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.508s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-362653951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef70c39096478f9f4e8b4d54a50341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:50Z,use_quota=True,user_id='49ffd658e25b4198afb4b5381dd90111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(053b63a9-cffe-4e46-a2fa-a7995bcd54e1),volume_type_id=053b63a9-cffe-4e46-a2fa-a7995bcd54e1)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Creating volume 3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:54:52 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b2a8da6-048c-49a1-a3c8-4e392e405760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941c4d81-6952-4679-bbd7-c804aaa13789', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:52 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 1073741824 Jun 23 12:54:52 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6acd1d7-aed2-4cfc-be4b-4971b8f94056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:52 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume volume-941c4d81-6952-4679-bbd7-c804aaa13789 (941c4d81-6952-4679-bbd7-c804aaa13789): created successfully Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6acd1d7-aed2-4cfc-be4b-4971b8f94056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Flow 'volume_create_manager' (a8ce6c34-34a4-40b9-bb09-6d9f77580893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:52 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-db32ea4b-4a42-4e36-8f87-6c60def3ba12 tempest-TestInstancesWithCinderVolumes-1855259179 None] Created volume successfully. Jun 23 12:54:53 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 1073741824" returned: 0 in 0.941s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:53 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 Jun 23 12:54:53 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:54 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63" returned: 0 in 0.685s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.921s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-eefb3c29-0232-4b26-9fea-9abecf59590c-bb88122f-96c4-456c-946b-f64c45419971" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b7b7a2-977e-424c-8c39-e332617a6967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73577029-68c9-40a0-b24b-348edd10c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-eefb3c29-0232-4b26-9fea-9abecf59590c-bb88122f-96c4-456c-946b-f64c45419971" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Creating volume bb88122f-96c4-456c-946b-f64c45419971 from snapshot eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-bb88122f-96c4-456c-946b-f64c45419971" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:54:54 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 (3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63): created successfully Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73577029-68c9-40a0-b24b-348edd10c117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Flow 'volume_create_manager' (9622f073-a44c-4124-9e18-1b1c25fa3cab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-bb88122f-96c4-456c-946b-f64c45419971" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] snapshot: eefb3c29-0232-4b26-9fea-9abecf59590c, volume: bb88122f-96c4-456c-946b-f64c45419971, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:54:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2560d405-dbd4-48ec-a6cb-7ff7eb146666 tempest-TestInstancesWithCinderVolumes-1855259179 None] Created volume successfully. Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18234a77-ae54-41c3-9b41-4f7f7ac45655]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:54 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c Jun 23 12:54:54 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:54 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD, size 20.69 MB, duration 3.72 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 12:54:54 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Image download 20.69 MB at 5.56 MB/s Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c97dcb-7f46-4927-a81a-0a13aceff8dc]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:55 devstack sudo[108649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD Jun 23 12:54:55 devstack sudo[108649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:55 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c" returned: 0 in 0.786s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[979f0aa5-a150-4e1b-a9cf-4e49fe515112]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:55 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 Jun 23 12:54:55 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:55 devstack sudo[108649]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Temporary image bf7a5025-39fa-45d3-b8b9-552cb57845a3 is fetched for user 49ffd658e25b4198afb4b5381dd90111. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c6b20e-2945-4aa2-9e15-5f139774340b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:55 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89" returned: 0 in 0.815s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:55 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD Jun 23 12:54:55 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:55 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:56 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 Jun 23 12:54:56 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Flow 'volume_create_manager' (2b1151e0-1d28-453a-8a71-c8c58dd89125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa617bcb-777e-4172-9b69-22800bcc5281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa617bcb-777e-4172-9b69-22800bcc5281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cc9944-d548-4fb1-b018-71ae8befd86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818e82dd962f4d31a5f8c95f22e5601d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:56Z,use_quota=True,user_id='f03da3cfc611490db2e8a519c5c87215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff5eedec-640a-49c0-872b-1ba30e982849),volume_type_id=ff5eedec-640a-49c0-872b-1ba30e982849)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b411cf-b0e8-468b-a985-f5e0559b0c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b411cf-b0e8-468b-a985-f5e0559b0c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde8a03c-827e-445f-b02a-f6eec484b144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde8a03c-827e-445f-b02a-f6eec484b144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69cc9944-d548-4fb1-b018-71ae8befd86c', 'volume_name': 'volume-69cc9944-d548-4fb1-b018-71ae8befd86c', 'volume_size': 1, 'image_id': '99192795-6954-447a-9f96-8400048a69f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99192795-6954-447a-9f96-8400048a69f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbbdc4d4b9446540dda5757b4f7f87f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '818e82dd962f4d31a5f8c95f22e5601d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94c31a929c74c02602a701652e876c53b24fb1418c0e302d9780a990fc60dd56b00b8519ad7506d7813745a72c50686a8e07661267e75a70e2a34daf94f76f9d', 'id': '99192795-6954-447a-9f96-8400048a69f8', 'created_at': datetime.datetime(2026, 6, 23, 10, 54, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 54, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99192795-6954-447a-9f96-8400048a69f8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:56 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6807e8-93dd-4def-b00e-0494afd45210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c6807e8-93dd-4def-b00e-0494afd45210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ff4289-2986-448c-8572-aa5b98b5c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:54:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Volume 69cc9944-d548-4fb1-b018-71ae8befd86c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69cc9944-d548-4fb1-b018-71ae8befd86c', 'volume_size': 1, 'image_id': '99192795-6954-447a-9f96-8400048a69f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99192795-6954-447a-9f96-8400048a69f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbbdc4d4b9446540dda5757b4f7f87f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '818e82dd962f4d31a5f8c95f22e5601d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94c31a929c74c02602a701652e876c53b24fb1418c0e302d9780a990fc60dd56b00b8519ad7506d7813745a72c50686a8e07661267e75a70e2a34daf94f76f9d', 'id': '99192795-6954-447a-9f96-8400048a69f8', 'created_at': datetime.datetime(2026, 6, 23, 10, 54, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 54, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99192795-6954-447a-9f96-8400048a69f8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Trying to clone 69cc9944-d548-4fb1-b018-71ae8befd86c from image 99192795-6954-447a-9f96-8400048a69f8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/99192795-6954-447a-9f96-8400048a69f8', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 12:54:56 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Image download 0.00 MB at 0.00 MB/s Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63d0953-bae8-4ddc-8896-e393b54d25ca]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:56 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD Jun 23 12:54:56 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:57 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD" returned: 0 in 1.144s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:58 devstack sudo[108683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD Jun 23 12:54:58 devstack sudo[108683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:54:59 devstack sudo[108683]: pam_unix(sudo:session): session closed for user root Jun 23 12:54:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD" returned: 1 in 1.299s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:54:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:54:59 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Temporary image 99192795-6954-447a-9f96-8400048a69f8 is fetched for user f03da3cfc611490db2e8a519c5c87215. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 12:54:59 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9df76a-28c6-4e75-9890-51359ad68c1b]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:54:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:54:59 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD Jun 23 12:54:59 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:00 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD" returned: 0 in 1.448s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:01 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD Jun 23 12:55:01 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:01 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971" returned: 0 in 5.070s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a29ec5-9378-46c8-9add-73026c947a6f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:01 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 Jun 23 12:55:01 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:01 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD" returned: 1 in 0.776s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:01 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89" returned: 0 in 0.893s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89, size 1024.00 MB, duration 5.07 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:55:01 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Converted 1024.00 MB image at 201.90 MB/s Jun 23 12:55:01 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 is being set with open permissions: ugo+rw Jun 23 12:55:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:02 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 Jun 23 12:55:02 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:02 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971" returned: 0 in 0.610s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-bb88122f-96c4-456c-946b-f64c45419971" released by "_copy_volume_from_snapshot" :: held 8.306s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-eefb3c29-0232-4b26-9fea-9abecf59590c-bb88122f-96c4-456c-946b-f64c45419971" released by "_create_volume_from_snapshot" :: held 8.352s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.391s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.926s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1094762175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae694e72-149a-407e-b126-8a01a75767cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77ef70c39096478f9f4e8b4d54a50341',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:51Z,use_quota=True,user_id='49ffd658e25b4198afb4b5381dd90111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(890e32c5-020e-44f5-9697-f88c2387f577),volume_type_id=890e32c5-020e-44f5-9697-f88c2387f577)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Creating volume ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:02 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:02 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf 1073741824 Jun 23 12:55:02 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc054533-ac52-4d1c-b42e-e5a9fd8a0633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb88122f-96c4-456c-946b-f64c45419971', 'volume_size': 2, 'snapshot_id': 'eefb3c29-0232-4b26-9fea-9abecf59590c'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b9f583-279b-49e6-bac4-4f81575e54ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:02 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Volume volume-bb88122f-96c4-456c-946b-f64c45419971 (bb88122f-96c4-456c-946b-f64c45419971): created successfully Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b9f583-279b-49e6-bac4-4f81575e54ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (e6e93d4e-a5d3-4410-9454-2fcdc7007294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-bdf27449-dc63-4ba0-a01b-0693c71604a2 tempest-VolumesSnapshotTestJSON-222993235 None] Created volume successfully. Jun 23 12:55:02 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=57,cinder:INSERT=18,cinder:UPDATE=59,cinder:DELETE=8 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-bb88122f-96c4-456c-946b-f64c45419971-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-bb88122f-96c4-456c-946b-f64c45419971-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-bb88122f-96c4-456c-946b-f64c45419971" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-bb88122f-96c4-456c-946b-f64c45419971" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b6d5a2-89b4-4377-9b1e-7f69d420127d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:03 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 Jun 23 12:55:03 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:03 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf 1073741824" returned: 0 in 0.809s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:03 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:55:03 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:03 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971" returned: 0 in 0.772s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:03 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971 Jun 23 12:55:03 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:04 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 0 in 0.655s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cc9944-d548-4fb1-b018-71ae8befd86c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818e82dd962f4d31a5f8c95f22e5601d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:54:56Z,use_quota=True,user_id='f03da3cfc611490db2e8a519c5c87215',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff5eedec-640a-49c0-872b-1ba30e982849),volume_type_id=ff5eedec-640a-49c0-872b-1ba30e982849)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Creating volume 69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:04 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:04 devstack sudo[108726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c 1073741824 Jun 23 12:55:04 devstack sudo[108726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Attempting download of bf7a5025-39fa-45d3-b8b9-552cb57845a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'metadata': {}}])) to volume ae694e72-149a-407e-b126-8a01a75767cf. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5581d-335c-4d82-bab9-b83f7b128599]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf7a5025-39fa-45d3-b8b9-552cb57845a3_1jxfhzo7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:04 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf7a5025-39fa-45d3-b8b9-552cb57845a3_1jxfhzo7 Jun 23 12:55:04 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:04 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bb88122f-96c4-456c-946b-f64c45419971" returned: 0 in 0.693s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-bb88122f-96c4-456c-946b-f64c45419971" released by "delete_volume" :: held 1.507s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['10d7ee01-9802-47b1-aa81-a7e1a3293944', 'e04b4a5c-fd0d-419c-977a-b643235b83b1', '032638f7-421e-492e-ba71-60aaed3acd7e', 'd309fa0a-64b3-4019-8b34-de8f84ad8755'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:04 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:04 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:05 devstack sudo[108726]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c 1073741824" returned: 0 in 0.893s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:05 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bf7a5025-39fa-45d3-b8b9-552cb57845a3_1jxfhzo7" returned: 0 in 0.850s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf7a5025-39fa-45d3-b8b9-552cb57845a3_1jxfhzo7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:05 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c Jun 23 12:55:05 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:05 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf7a5025-39fa-45d3-b8b9-552cb57845a3_1jxfhzo7 Jun 23 12:55:05 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-eefb3c29-0232-4b26-9fea-9abecf59590c-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-eefb3c29-0232-4b26-9fea-9abecf59590c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-59c8e8b7-7568-45b3-910e-2dcec95ffc89" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-59c8e8b7-7568-45b3-910e-2dcec95ffc89" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-eefb3c29-0232-4b26-9fea-9abecf59590c" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-eefb3c29-0232-4b26-9fea-9abecf59590c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:05 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Deleting offline snapshot eefb3c29-0232-4b26-9fea-9abecf59590c of volume 59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] snapshot_file for this snap is: volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.729s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Deleted volume successfully. Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c959b467-1c37-4239-8468-991acb29f816]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-aaf71ba2-e703-49f2-b048-deda82bd506d tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-bb88122f-96c4-456c-946b-f64c45419971-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:05 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c Jun 23 12:55:05 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:05 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c" returned: 0 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Attempting download of 99192795-6954-447a-9f96-8400048a69f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/99192795-6954-447a-9f96-8400048a69f8', 'metadata': {}}])) to volume 69cc9944-d548-4fb1-b018-71ae8befd86c. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0ffcb8-191a-45cb-83ce-aa489653921e]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99192795-6954-447a-9f96-8400048a69f8_71bmloyr {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:05 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf7a5025-39fa-45d3-b8b9-552cb57845a3_1jxfhzo7" returned: 1 in 0.891s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bf7a5025-39fa-45d3-b8b9-552cb57845a3_1jxfhzo7' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3601c794-ebcd-4fb2-a32c-0a37e852e591]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:06 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99192795-6954-447a-9f96-8400048a69f8_71bmloyr Jun 23 12:55:06 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:06 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD Jun 23 12:55:06 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:06 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c" returned: 0 in 0.868s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8d06fb-3d80-4b6a-aafd-baf83658aaf8]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:06 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 Jun 23 12:55:06 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:06 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_99192795-6954-447a-9f96-8400048a69f8_71bmloyr" returned: 0 in 0.769s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99192795-6954-447a-9f96-8400048a69f8_71bmloyr {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:06 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99192795-6954-447a-9f96-8400048a69f8_71bmloyr Jun 23 12:55:06 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:06 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] bf7a5025-39fa-45d3-b8b9-552cb57845a3 was qcow2, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 12:55:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:06 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:55:06 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:07 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89" returned: 0 in 0.814s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:07 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c Jun 23 12:55:07 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:07 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99192795-6954-447a-9f96-8400048a69f8_71bmloyr" returned: 1 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_99192795-6954-447a-9f96-8400048a69f8_71bmloyr' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b53bea9-c296-48d4-94db-081cc2396a42]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:07 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD Jun 23 12:55:07 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:08 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:08 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c Jun 23 12:55:08 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:08 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD" returned: 0 in 0.853s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:08 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD Jun 23 12:55:08 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:08 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 0 in 2.054s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bf7a5025-39fa-45d3-b8b9-552cb57845a3_o2fyqe8mdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:55:08 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Converted 112.00 MB image at 54.48 MB/s Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:08 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf 1G Jun 23 12:55:08 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:08 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89.eefb3c29-0232-4b26-9fea-9abecf59590c" returned: 0 in 0.778s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-eefb3c29-0232-4b26-9fea-9abecf59590c" released by "_delete_snapshot" :: held 3.467s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-59c8e8b7-7568-45b3-910e-2dcec95ffc89" released by "delete_snapshot" :: held 3.508s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:09 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD" returned: 1 in 0.768s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] 99192795-6954-447a-9f96-8400048a69f8 was raw, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:09 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c Jun 23 12:55:09 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['e2e87bed-e964-4f9d-a7d8-8e378928f405', 'bb746c0d-8e2d-4ee4-882b-7a9eb141c17d', '91aabc1a-f7b8-4ea6-9c43-22d7ccf76a0d', 'd9e81766-6090-4ff9-93c5-65da55af90e3'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Delete snapshot completed successfully. Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c88a9f99-2fc4-4b19-b841-1328b903f09b tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-eefb3c29-0232-4b26-9fea-9abecf59590c-delete_snapshot" released by "delete_snapshot" :: held 3.686s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:09 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf 1G" returned: 0 in 0.779s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ca1c1a-3ef2-4290-862b-28918a795c41]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:09 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c" returned: 0 in 0.759s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_99192795-6954-447a-9f96-8400048a69f8_k5f4ahe1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:55:09 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-59c8e8b7-7568-45b3-910e-2dcec95ffc89-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:09 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:55:09 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:09 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c 1G Jun 23 12:55:09 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-59c8e8b7-7568-45b3-910e-2dcec95ffc89-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-59c8e8b7-7568-45b3-910e-2dcec95ffc89" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-59c8e8b7-7568-45b3-910e-2dcec95ffc89" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb1b1e-2401-4b66-931e-16d129ce98af]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:10 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 Jun 23 12:55:10 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:10 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 0 in 0.847s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:10 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c 1G" returned: 0 in 0.819s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:10 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb387486-70e0-4c08-997d-6fb9817b9f7d]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:10 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:55:10 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:10 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c Jun 23 12:55:10 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:10 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89" returned: 0 in 1.052s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:11 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89 Jun 23 12:55:11 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:11 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 1 in 0.988s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Downloaded image bf7a5025-39fa-45d3-b8b9-552cb57845a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'metadata': {}}])) to volume ae694e72-149a-407e-b126-8a01a75767cf successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Temporary image bf7a5025-39fa-45d3-b8b9-552cb57845a3 for user 49ffd658e25b4198afb4b5381dd90111 is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Marking volume ae694e72-149a-407e-b126-8a01a75767cf as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Copying metadata from image bf7a5025-39fa-45d3-b8b9-552cb57845a3 to ae694e72-149a-407e-b126-8a01a75767cf. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Creating volume glance metadata for volume ae694e72-149a-407e-b126-8a01a75767cf backed by image bf7a5025-39fa-45d3-b8b9-552cb57845a3 with: {'image_id': 'bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'image_name': 'tempest-scenario-img--397129212', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe668a9a-1eca-49cb-871e-9b85dfa67eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae694e72-149a-407e-b126-8a01a75767cf', 'volume_size': 1, 'image_id': 'bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--397129212', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '77ef70c39096478f9f4e8b4d54a50341', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bf7a5025-39fa-45d3-b8b9-552cb57845a3', 'created_at': datetime.datetime(2026, 6, 23, 10, 54, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 54, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bf7a5025-39fa-45d3-b8b9-552cb57845a3/file', 'properties': {}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2feef8-c8d0-4d16-906a-28c52b82f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Volume volume-ae694e72-149a-407e-b126-8a01a75767cf (ae694e72-149a-407e-b126-8a01a75767cf): created successfully Jun 23 12:55:11 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2feef8-c8d0-4d16-906a-28c52b82f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Flow 'volume_create_manager' (4c8d8308-9fd2-4b29-9113-e605fe60f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c" returned: 0 in 0.964s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7841bf4b-ac63-441c-b6b3-4b57b18b1cbc tempest-TestInstancesWithCinderVolumes-1855259179 None] Created volume successfully. Jun 23 12:55:11 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c Jun 23 12:55:11 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:11 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-59c8e8b7-7568-45b3-910e-2dcec95ffc89" returned: 0 in 0.778s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-59c8e8b7-7568-45b3-910e-2dcec95ffc89" released by "delete_volume" :: held 1.903s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['c28f9bf1-767c-4223-9cd1-339c80ffe29f', '12ef6ab4-d3cb-40f3-9699-f8353e010f70', 'cc029514-13cc-4f37-9079-7af46cb9ca17', '501d5814-07fd-42b3-8c52-338d3cc0a4be'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:11 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:11 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:12 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c" returned: 1 in 1.008s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Downloaded image 99192795-6954-447a-9f96-8400048a69f8 ((None, [{'url': 'file:///opt/stack/data/glance/images/99192795-6954-447a-9f96-8400048a69f8', 'metadata': {}}])) to volume 69cc9944-d548-4fb1-b018-71ae8befd86c successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Temporary image 99192795-6954-447a-9f96-8400048a69f8 for user f03da3cfc611490db2e8a519c5c87215 is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Marking volume 69cc9944-d548-4fb1-b018-71ae8befd86c as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Copying metadata from image 99192795-6954-447a-9f96-8400048a69f8 to 69cc9944-d548-4fb1-b018-71ae8befd86c. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Creating volume glance metadata for volume 69cc9944-d548-4fb1-b018-71ae8befd86c backed by image 99192795-6954-447a-9f96-8400048a69f8 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '99192795-6954-447a-9f96-8400048a69f8', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bbbdc4d4b9446540dda5757b4f7f87f1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 12:55:12 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.775s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Deleted volume successfully. Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ce1120e1-9f45-4d7f-8e26-ac42923a356c tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-59c8e8b7-7568-45b3-910e-2dcec95ffc89-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ff4289-2986-448c-8572-aa5b98b5c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cc9944-d548-4fb1-b018-71ae8befd86c', 'volume_size': 1, 'image_id': '99192795-6954-447a-9f96-8400048a69f8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/99192795-6954-447a-9f96-8400048a69f8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bbbdc4d4b9446540dda5757b4f7f87f1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '818e82dd962f4d31a5f8c95f22e5601d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '94c31a929c74c02602a701652e876c53b24fb1418c0e302d9780a990fc60dd56b00b8519ad7506d7813745a72c50686a8e07661267e75a70e2a34daf94f76f9d', 'id': '99192795-6954-447a-9f96-8400048a69f8', 'created_at': datetime.datetime(2026, 6, 23, 10, 54, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 10, 54, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/99192795-6954-447a-9f96-8400048a69f8/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cf350e-2832-4679-86da-67eacca0e7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (806abf8f-ee49-468b-9c92-8a714c54426c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4fd86f-624e-4c07-9d64-0ceb65daf5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:12 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Volume volume-69cc9944-d548-4fb1-b018-71ae8befd86c (69cc9944-d548-4fb1-b018-71ae8befd86c): created successfully Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1cf350e-2832-4679-86da-67eacca0e7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Flow 'volume_create_manager' (2b1151e0-1d28-453a-8a71-c8c58dd89125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4fd86f-624e-4c07-9d64-0ceb65daf5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-110431435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f55089-ef4a-47e3-90b0-136581fafe2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:13Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6c0702-288d-4c1c-958c-c0a70863879c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d6c0702-288d-4c1c-958c-c0a70863879c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28afb534-3370-4f37-a4c8-84aee5afda8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28afb534-3370-4f37-a4c8-84aee5afda8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f55089-ef4a-47e3-90b0-136581fafe2f', 'volume_name': 'volume-80f55089-ef4a-47e3-90b0-136581fafe2f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b74cfee-b892-449a-8893-55fa4bfaf3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b74cfee-b892-449a-8893-55fa4bfaf3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026dadc9-b1a6-4c1d-920b-d1898804d89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:12 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Volume 80f55089-ef4a-47e3-90b0-136581fafe2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f55089-ef4a-47e3-90b0-136581fafe2f', 'volume_size': 1} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-110431435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f55089-ef4a-47e3-90b0-136581fafe2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:13Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Creating volume 80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:12 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-72440490-c340-4ec2-853c-a6684e935e7f tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Created volume successfully. Jun 23 12:55:12 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f 1073741824 Jun 23 12:55:12 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Acquiring lock "cinder-69cc9944-d548-4fb1-b018-71ae8befd86c-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "cinder-69cc9944-d548-4fb1-b018-71ae8befd86c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Acquiring lock "cinder-quobyte-69cc9944-d548-4fb1-b018-71ae8befd86c" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "cinder-quobyte-69cc9944-d548-4fb1-b018-71ae8befd86c" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:13 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca44f7f-d2b9-407a-af47-cac710f0249f]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:14 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f 1073741824" returned: 0 in 1.108s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:14 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c Jun 23 12:55:14 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:14 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f Jun 23 12:55:14 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:14 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f" returned: 0 in 0.711s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:14 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026dadc9-b1a6-4c1d-920b-d1898804d89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f55089-ef4a-47e3-90b0-136581fafe2f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10590c44-4a84-424a-83a7-9266a62d595e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c" returned: 0 in 0.918s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:14 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Volume volume-80f55089-ef4a-47e3-90b0-136581fafe2f (80f55089-ef4a-47e3-90b0-136581fafe2f): created successfully Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10590c44-4a84-424a-83a7-9266a62d595e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (806abf8f-ee49-468b-9c92-8a714c54426c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:14 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0aff5dab-035d-4b09-b84e-b9a02b31c750 tempest-VolumesSnapshotTestJSON-222993235 None] Created volume successfully. Jun 23 12:55:14 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c Jun 23 12:55:14 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:15 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c" returned: 1 in 0.827s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:15 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c Jun 23 12:55:15 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Creating offline snapshot 19f154db-5676-4d6f-9c7f-99f55de15045 of volume 80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[625ca8fb-56a5-4982-ba29-0781bd574932]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:16 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f Jun 23 12:55:16 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:16 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69cc9944-d548-4fb1-b018-71ae8befd86c" returned: 0 in 0.699s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "cinder-quobyte-69cc9944-d548-4fb1-b018-71ae8befd86c" released by "delete_volume" :: held 2.508s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:16 devstack cinder-volume[93659]: WARNING cinder.quota [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:55:16 devstack cinder-volume[93659]: WARNING cinder.quota [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Created reservations ['f3947371-ecd2-4254-88e3-de9afecde9a4', '0f5079a3-f9fc-42fd-8315-6a3da1d782c3', 'bb10974b-700a-4489-96b1-849329929c0d', '0788b1d2-7d49-4511-8bb5-489f399176cf'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:16 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:16 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:16 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f" returned: 0 in 0.788s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:17 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 1G Jun 23 12:55:17 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:17 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.696s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:17 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Deleted volume successfully. Jun 23 12:55:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6954e850-1199-4c42-9d6b-58ed2c97e9de tempest-VolumeAndVolumeTypeFromImageTest-1948041085 None] Lock "cinder-69cc9944-d548-4fb1-b018-71ae8befd86c-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:17 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 1G" returned: 0 in 0.902s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f55089-ef4a-47e3-90b0-136581fafe2f -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:17 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f55089-ef4a-47e3-90b0-136581fafe2f -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 Jun 23 12:55:17 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:18 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80f55089-ef4a-47e3-90b0-136581fafe2f -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045" returned: 0 in 0.872s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:18 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 is being set with open permissions: ugo+rw Jun 23 12:55:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:18 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 Jun 23 12:55:18 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:19 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045" returned: 0 in 0.951s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:19 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=78,cinder:INSERT=27,cinder:UPDATE=79,cinder:DELETE=6 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:55:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:19 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.info Jun 23 12:55:19 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:20 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.info" returned: 0 in 0.832s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:20 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.info is being set with open permissions: ugo+rw Jun 23 12:55:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:20 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.info Jun 23 12:55:20 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:21 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.info" returned: 0 in 0.802s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.275s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.584s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:21 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-daaa2d5e-ea1f-427e-abf5-4e7b3386ff5a tempest-VolumesSnapshotTestJSON-222993235 None] Create snapshot completed successfully Jun 23 12:55:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3654ab3-17d6-4e8b-af7d-51108eb3b838]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:21 devstack sudo[109357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:55:21 devstack sudo[109357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:22 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:22 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:22 devstack sudo[109357]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 0 in 0.851s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:22 devstack sudo[109363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:55:22 devstack sudo[109363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (65739b40-8558-4845-a7a4-9cfbfeadeb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4c776-07c0-408f-933a-28a28abd2675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4c776-07c0-408f-933a-28a28abd2675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1632171826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b3b3e-fd30-481c-97c8-2b06217d05ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:23Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b64fc6d-b3aa-41be-8eb9-eb0016067bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b64fc6d-b3aa-41be-8eb9-eb0016067bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b80252-b088-4072-b7db-ee97a68ef43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b80252-b088-4072-b7db-ee97a68ef43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32b3b3e-fd30-481c-97c8-2b06217d05ae', 'volume_name': 'volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0857d567-752f-4dd3-ba80-b63b7b54be5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0857d567-752f-4dd3-ba80-b63b7b54be5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadac2b3-8f32-4787-a390-ee84e4e2dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:22 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Volume a32b3b3e-fd30-481c-97c8-2b06217d05ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae', 'volume_size': 1} Jun 23 12:55:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:23 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.869s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (4bfe0ff4-a6ef-40aa-a99b-3a7e0df1eddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f709ba-a78a-4330-a37f-4d5de6e4754e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f709ba-a78a-4330-a37f-4d5de6e4754e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272516337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0064e88d-0422-4c25-9042-622b90ad139e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:23Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a5dafd-a354-4eab-917e-0e2004744365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack sudo[109363]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93a5dafd-a354-4eab-917e-0e2004744365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa103b1d-89d4-47bd-a5d6-73a1eeee9ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa103b1d-89d4-47bd-a5d6-73a1eeee9ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0064e88d-0422-4c25-9042-622b90ad139e', 'volume_name': 'volume-0064e88d-0422-4c25-9042-622b90ad139e', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaeaedc-bdea-4a4e-a2a3-3dc1211e4aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaeaedc-bdea-4a4e-a2a3-3dc1211e4aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9766c71-a7ea-4fca-bbf2-46a7fcd21ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Volume 0064e88d-0422-4c25-9042-622b90ad139e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0064e88d-0422-4c25-9042-622b90ad139e', 'volume_size': 1} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 1 in 0.884s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.786s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1632171826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b3b3e-fd30-481c-97c8-2b06217d05ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:23Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Creating volume a32b3b3e-fd30-481c-97c8-2b06217d05ae {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:23 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:23 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae 1073741824 Jun 23 12:55:23 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-ae694e72-149a-407e-b126-8a01a75767cf', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5a05cd1-71b0-4986-9b15-d705091bf307', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:55:23 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-9c1090ad-3a6a-45be-a504-d50721de0ad0 req-37e55182-6907-4797-8e6f-a6285f614e64 tempest-TestInstancesWithCinderVolumes-1855259179 None] attachment_update completed successfully. Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (5ab4a5c9-2d86-4bbb-8b24-b2be73aa0e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb526fa-483e-4723-9ba0-aadfaa4aceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eb526fa-483e-4723-9ba0-aadfaa4aceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-318968699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16599740-35a3-4b3f-8528-2bbe582214b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc8f6eb687a4884b099ff8be2ae019d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=19f154db-5676-4d6f-9c7f-99f55de15045,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:24Z,use_quota=True,user_id='7af145aac7d04518b746c15c3707190d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47748a02-b8a6-40cd-869f-4229c135f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47748a02-b8a6-40cd-869f-4229c135f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12831a8b-39d8-40c0-9929-6fd09028d36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12831a8b-39d8-40c0-9929-6fd09028d36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16599740-35a3-4b3f-8528-2bbe582214b2', 'volume_name': 'volume-16599740-35a3-4b3f-8528-2bbe582214b2', 'volume_size': 1, 'snapshot_id': '19f154db-5676-4d6f-9c7f-99f55de15045'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d5cd64-332f-4956-bfbb-673e9b4a923b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d5cd64-332f-4956-bfbb-673e9b4a923b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f7ab50-fb12-4e82-b7b8-76e555fcff8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:23 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Volume 16599740-35a3-4b3f-8528-2bbe582214b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16599740-35a3-4b3f-8528-2bbe582214b2', 'volume_size': 1, 'snapshot_id': '19f154db-5676-4d6f-9c7f-99f55de15045'} Jun 23 12:55:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (faa0bbe4-9ea1-4e1f-8b2b-6f0ac67d5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1408319a-daaf-4820-857e-86a336594f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1408319a-daaf-4820-857e-86a336594f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192665109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79d3b65-5b50-4a60-898c-b56cb72d721b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:24Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dded68a2-b68b-479e-b689-7c788fb88f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dded68a2-b68b-479e-b689-7c788fb88f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e87e5b-88f5-4956-a2f8-7ba916bf630b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e87e5b-88f5-4956-a2f8-7ba916bf630b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79d3b65-5b50-4a60-898c-b56cb72d721b', 'volume_name': 'volume-c79d3b65-5b50-4a60-898c-b56cb72d721b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c6f407-22c5-44a6-b33f-03e9a44fa323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c6f407-22c5-44a6-b33f-03e9a44fa323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eec0e8-fb24-4ace-8eba-e220975c0e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Volume c79d3b65-5b50-4a60-898c-b56cb72d721b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79d3b65-5b50-4a60-898c-b56cb72d721b', 'volume_size': 1} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:24 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae 1073741824" returned: 0 in 1.083s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:24 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae Jun 23 12:55:24 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (f0d574c2-a655-43d1-8358-2ed0ac0ab175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4eab62-600b-4af0-b01e-98219e276b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4eab62-600b-4af0-b01e-98219e276b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957075395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561cfa11-44bf-4cd3-aa55-281e1db1e16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:25Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3638cd-f41d-4d60-80a5-ecf47f4f6ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3638cd-f41d-4d60-80a5-ecf47f4f6ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092442e9-4f5d-41f3-9669-bdeb64378b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092442e9-4f5d-41f3-9669-bdeb64378b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561cfa11-44bf-4cd3-aa55-281e1db1e16b', 'volume_name': 'volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0252b8c6-685a-4943-a0b0-6a1380a0de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0252b8c6-685a-4943-a0b0-6a1380a0de19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a0bd19-9019-4952-a120-073d47645fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Volume 561cfa11-44bf-4cd3-aa55-281e1db1e16b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b', 'volume_size': 1} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (1abe9aab-0800-4539-b240-c296bf8a2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f1c77e-3dc0-4836-a39e-709d7f328121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f1c77e-3dc0-4836-a39e-709d7f328121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059323391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5112516f-1609-4471-a373-5cf3de85eab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:25Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322d448-2083-466b-be86-049e8c190de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322d448-2083-466b-be86-049e8c190de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bf27a0-2895-4a25-b0dc-4d02d8208f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bf27a0-2895-4a25-b0dc-4d02d8208f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5112516f-1609-4471-a373-5cf3de85eab0', 'volume_name': 'volume-5112516f-1609-4471-a373-5cf3de85eab0', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea981af3-70eb-4a98-ad76-02ed7c6bd784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:25 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea981af3-70eb-4a98-ad76-02ed7c6bd784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feb1271-f16b-45c4-b790-79b462a7aab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:25 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Volume 5112516f-1609-4471-a373-5cf3de85eab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5112516f-1609-4471-a373-5cf3de85eab0', 'volume_size': 1} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae" returned: 0 in 0.734s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1272516337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0064e88d-0422-4c25-9042-622b90ad139e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:23Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Creating volume 0064e88d-0422-4c25-9042-622b90ad139e {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:25 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:25 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e 1073741824 Jun 23 12:55:25 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aadac2b3-8f32-4787-a390-ee84e4e2dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e716d185-7996-4e11-a3e0-49953eb44273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:25 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Volume volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae (a32b3b3e-fd30-481c-97c8-2b06217d05ae): created successfully Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e716d185-7996-4e11-a3e0-49953eb44273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (65739b40-8558-4845-a7a4-9cfbfeadeb5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:25 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9942e011-682b-4c20-a749-2e672a24433c tempest-CreateVolumesFromImageTest-1381838956 None] Created volume successfully. Jun 23 12:55:25 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e 1073741824" returned: 0 in 0.859s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:26 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e Jun 23 12:55:26 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:26 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e" returned: 0 in 0.629s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.735s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-19f154db-5676-4d6f-9c7f-99f55de15045-16599740-35a3-4b3f-8528-2bbe582214b2" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-19f154db-5676-4d6f-9c7f-99f55de15045-16599740-35a3-4b3f-8528-2bbe582214b2" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Creating volume 16599740-35a3-4b3f-8528-2bbe582214b2 from snapshot 19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-16599740-35a3-4b3f-8528-2bbe582214b2" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9766c71-a7ea-4fca-bbf2-46a7fcd21ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0064e88d-0422-4c25-9042-622b90ad139e', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd73019-c8f7-40b5-a634-488a2d43bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-16599740-35a3-4b3f-8528-2bbe582214b2" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] snapshot: 19f154db-5676-4d6f-9c7f-99f55de15045, volume: 16599740-35a3-4b3f-8528-2bbe582214b2, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:55:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Volume volume-0064e88d-0422-4c25-9042-622b90ad139e (0064e88d-0422-4c25-9042-622b90ad139e): created successfully Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd73019-c8f7-40b5-a634-488a2d43bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (4bfe0ff4-a6ef-40aa-a99b-3a7e0df1eddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:26 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-3127f7a9-b609-4326-a81e-e47386817acf tempest-CreateVolumesFromImageTest-1381838956 None] Created volume successfully. Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c4c702-bffe-48e6-8838-de1a9d20a717]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:26 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 Jun 23 12:55:26 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:27 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045" returned: 0 in 0.772s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f55089-ef4a-47e3-90b0-136581fafe2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:55:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:55:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:55:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1185d6-b52e-475c-a95f-42990e3a3109]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:27 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f Jun 23 12:55:27 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:28 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f" returned: 0 in 0.743s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:28 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:55:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:28 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 Jun 23 12:55:28 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:34 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2" returned: 0 in 6.026s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d3c2a0-3f7b-4c03-a5ae-db406a3f0501]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:34 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f Jun 23 12:55:34 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:35 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f" returned: 0 in 1.120s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:35 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f, size 1024.00 MB, duration 6.03 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:55:35 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Converted 1024.00 MB image at 169.87 MB/s Jun 23 12:55:35 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 is being set with open permissions: ugo+rw Jun 23 12:55:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:35 devstack sudo[109888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 Jun 23 12:55:35 devstack sudo[109888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:36 devstack sudo[109888]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2" returned: 0 in 0.712s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-16599740-35a3-4b3f-8528-2bbe582214b2" released by "_copy_volume_from_snapshot" :: held 9.492s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-19f154db-5676-4d6f-9c7f-99f55de15045-16599740-35a3-4b3f-8528-2bbe582214b2" released by "_create_volume_from_snapshot" :: held 9.535s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.553s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.977s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192665109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79d3b65-5b50-4a60-898c-b56cb72d721b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:24Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Creating volume c79d3b65-5b50-4a60-898c-b56cb72d721b {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:36 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:36 devstack sudo[109892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b 1073741824 Jun 23 12:55:36 devstack sudo[109892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8f7ab50-fb12-4e82-b7b8-76e555fcff8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16599740-35a3-4b3f-8528-2bbe582214b2', 'volume_size': 1, 'snapshot_id': '19f154db-5676-4d6f-9c7f-99f55de15045'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb427b90-7ce0-47c2-bd15-4e3ad4c0ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:36 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Volume volume-16599740-35a3-4b3f-8528-2bbe582214b2 (16599740-35a3-4b3f-8528-2bbe582214b2): created successfully Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb427b90-7ce0-47c2-bd15-4e3ad4c0ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:36 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Flow 'volume_create_manager' (5ab4a5c9-2d86-4bbb-8b24-b2be73aa0e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6824d509-ee75-4583-be39-26ffcee2e478 tempest-VolumesSnapshotTestJSON-222993235 None] Created volume successfully. Jun 23 12:55:37 devstack sudo[109892]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b 1073741824" returned: 0 in 1.222s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:37 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b Jun 23 12:55:37 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-16599740-35a3-4b3f-8528-2bbe582214b2-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-16599740-35a3-4b3f-8528-2bbe582214b2-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-16599740-35a3-4b3f-8528-2bbe582214b2" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-16599740-35a3-4b3f-8528-2bbe582214b2" acquired by "delete_volume" :: waited 0.032s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2fff39-21b2-4dfd-8190-b114360cc769]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:38 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 Jun 23 12:55:38 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:38 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b" returned: 0 in 1.086s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.378s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.849s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-957075395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561cfa11-44bf-4cd3-aa55-281e1db1e16b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:25Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Creating volume 561cfa11-44bf-4cd3-aa55-281e1db1e16b {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:38 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:38 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b 1073741824 Jun 23 12:55:38 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2eec0e8-fb24-4ace-8eba-e220975c0e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79d3b65-5b50-4a60-898c-b56cb72d721b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99253d2-e591-4ac3-b6ad-9a3f38df0a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:38 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Volume volume-c79d3b65-5b50-4a60-898c-b56cb72d721b (c79d3b65-5b50-4a60-898c-b56cb72d721b): created successfully Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99253d2-e591-4ac3-b6ad-9a3f38df0a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (faa0bbe4-9ea1-4e1f-8b2b-6f0ac67d5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8bf7509c-217a-4889-8fe6-45e4f087e53b tempest-CreateVolumesFromImageTest-1381838956 None] Created volume successfully. Jun 23 12:55:39 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2" returned: 0 in 1.115s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:39 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2 Jun 23 12:55:39 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:39 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b 1073741824" returned: 0 in 1.100s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:39 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b Jun 23 12:55:39 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:40 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-16599740-35a3-4b3f-8528-2bbe582214b2" returned: 0 in 0.923s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-16599740-35a3-4b3f-8528-2bbe582214b2" released by "delete_volume" :: held 2.131s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['15102a62-5b86-44ca-82fe-6512d387193a', '65a1b3f8-a5fc-443c-b25a-c60458c02096', '91b431d5-2f6d-4571-ac72-0caa68ed873c', 'a06350ea-172a-42a4-8d0e-d99ab2aeee3d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:40 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:40 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:40 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b" returned: 0 in 0.869s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.521s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2059323391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5112516f-1609-4471-a373-5cf3de85eab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e90059a67240d48a234a3929e28d63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:55:25Z,use_quota=True,user_id='b7486dbc2d524ea09f62818bc3e51153',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Creating volume 5112516f-1609-4471-a373-5cf3de85eab0 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:55:40 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:40 devstack sudo[109924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 1073741824 Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a0bd19-9019-4952-a120-073d47645fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:40 devstack sudo[109924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b19bb51-7228-460d-957f-5e9d746bb377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:40 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Volume volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b (561cfa11-44bf-4cd3-aa55-281e1db1e16b): created successfully Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b19bb51-7228-460d-957f-5e9d746bb377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:40 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (f0d574c2-a655-43d1-8358-2ed0ac0ab175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-86704048-5887-4eea-8158-ed4c584d3888 tempest-CreateVolumesFromImageTest-1381838956 None] Created volume successfully. Jun 23 12:55:40 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.788s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:41 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Deleted volume successfully. Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5494fd92-d5da-4665-a2ec-1d9be99241bd tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-16599740-35a3-4b3f-8528-2bbe582214b2-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-19f154db-5676-4d6f-9c7f-99f55de15045-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-19f154db-5676-4d6f-9c7f-99f55de15045-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-80f55089-ef4a-47e3-90b0-136581fafe2f" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-80f55089-ef4a-47e3-90b0-136581fafe2f" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-19f154db-5676-4d6f-9c7f-99f55de15045" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-19f154db-5676-4d6f-9c7f-99f55de15045" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Deleting offline snapshot 19f154db-5676-4d6f-9c7f-99f55de15045 of volume 80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] snapshot_file for this snap is: volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7e232-e727-41d3-8b95-7556f81904f8]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:41 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 Jun 23 12:55:41 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:42 devstack sudo[109924]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 1073741824" returned: 0 in 1.411s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:42 devstack sudo[109936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 Jun 23 12:55:42 devstack sudo[109936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:42 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045" returned: 0 in 1.006s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80f55089-ef4a-47e3-90b0-136581fafe2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d619f4-6751-487e-bdf0-425438eee99e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:42 devstack sudo[109941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f Jun 23 12:55:42 devstack sudo[109941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:42 devstack sudo[109936]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0" returned: 0 in 0.690s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5feb1271-f16b-45c4-b790-79b462a7aab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5112516f-1609-4471-a373-5cf3de85eab0', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b0e321-d89a-4a5e-b0be-f6244761aec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:55:42 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Volume volume-5112516f-1609-4471-a373-5cf3de85eab0 (5112516f-1609-4471-a373-5cf3de85eab0): created successfully Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48b0e321-d89a-4a5e-b0be-f6244761aec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:55:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Flow 'volume_create_manager' (1abe9aab-0800-4539-b240-c296bf8a2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:55:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b3bbcccd-91dc-4601-bd1c-0e0d1c0ba8dd tempest-CreateVolumesFromImageTest-1381838956 None] Created volume successfully. Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-5112516f-1609-4471-a373-5cf3de85eab0-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-5112516f-1609-4471-a373-5cf3de85eab0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-quobyte-5112516f-1609-4471-a373-5cf3de85eab0" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-5112516f-1609-4471-a373-5cf3de85eab0" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3413a9-bf20-4412-b4f1-885ba3251efa]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:43 devstack sudo[109941]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f" returned: 0 in 0.857s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:43 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 Jun 23 12:55:43 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:43 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 Jun 23 12:55:43 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:44 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0" returned: 0 in 0.818s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:44 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045" returned: 0 in 0.777s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:44 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0 Jun 23 12:55:44 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:44 devstack sudo[109960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045 Jun 23 12:55:44 devstack sudo[109960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:44 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5112516f-1609-4471-a373-5cf3de85eab0" returned: 0 in 0.672s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-5112516f-1609-4471-a373-5cf3de85eab0" released by "delete_volume" :: held 1.532s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:44 devstack sudo[109960]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f.19f154db-5676-4d6f-9c7f-99f55de15045" returned: 0 in 0.699s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-19f154db-5676-4d6f-9c7f-99f55de15045" released by "_delete_snapshot" :: held 3.474s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-80f55089-ef4a-47e3-90b0-136581fafe2f" released by "delete_snapshot" :: held 3.520s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Created reservations ['878a6fb8-89f4-4363-a11b-daf4a07a7063', 'e2859e5e-2a8a-474a-8454-868749bb339c', '6fb81454-4792-4161-924c-9a321f34e609', 'e97e34fe-e385-461a-9357-1d8cadcaee97'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:44 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['16d4a485-0aa0-4c1e-a52d-12162425e07b', '6c58c1f0-c53d-44d6-a4e6-aa850023a9c2', '10aeffc5-df4e-454f-822a-2e158a85fffd', '95768c21-9ea1-472c-aa46-0515b8c543a1'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:44 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:44 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Delete snapshot completed successfully. Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-641df4d2-921d-45d6-8fa2-292726e95e90 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-19f154db-5676-4d6f-9c7f-99f55de15045-delete_snapshot" released by "delete_snapshot" :: held 3.738s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-561cfa11-44bf-4cd3-aa55-281e1db1e16b-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-561cfa11-44bf-4cd3-aa55-281e1db1e16b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-quobyte-561cfa11-44bf-4cd3-aa55-281e1db1e16b" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-561cfa11-44bf-4cd3-aa55-281e1db1e16b" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c846139-928c-42bd-89b1-9222b01c5150]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-80f55089-ef4a-47e3-90b0-136581fafe2f-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:45 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.762s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-80f55089-ef4a-47e3-90b0-136581fafe2f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:45 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Deleted volume successfully. Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6fad3120-e08b-4309-9786-d23f040d6210 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-5112516f-1609-4471-a373-5cf3de85eab0-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-80f55089-ef4a-47e3-90b0-136581fafe2f" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-80f55089-ef4a-47e3-90b0-136581fafe2f" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:45 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b Jun 23 12:55:45 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc496c7-7c49-4210-b55d-96a8e6146496]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:45 devstack sudo[109994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f Jun 23 12:55:45 devstack sudo[109994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:46 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b" returned: 0 in 0.919s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:46 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b Jun 23 12:55:46 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:46 devstack sudo[109994]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f" returned: 0 in 0.790s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:46 devstack sudo[110004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f Jun 23 12:55:46 devstack sudo[110004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:47 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-561cfa11-44bf-4cd3-aa55-281e1db1e16b" returned: 0 in 0.705s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-561cfa11-44bf-4cd3-aa55-281e1db1e16b" released by "delete_volume" :: held 1.690s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Created reservations ['93fa38bd-b720-4c22-8e35-622ef0c73621', 'c690b155-c0cb-4f57-be81-45f74c950a24', 'bc171589-0cc2-4bd1-a41d-cadc9430a0b9', 'e6bceb62-007b-4947-aff3-dea07188446a'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:47 devstack sudo[110004]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-80f55089-ef4a-47e3-90b0-136581fafe2f" returned: 0 in 0.726s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-80f55089-ef4a-47e3-90b0-136581fafe2f" released by "delete_volume" :: held 1.609s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['1efa1e43-e4eb-43b8-9e3e-fb03ecb022c8', '531e8384-afea-4360-b849-4b9e0f2502e3', 'e380dee2-d542-4cb5-94a0-8dc2efdcd5bc', '08241971-d5b6-49d4-a295-c680efab4022'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:47 devstack sudo[110057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:47 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:47 devstack sudo[110091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:47 devstack sudo[110091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-c79d3b65-5b50-4a60-898c-b56cb72d721b-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-c79d3b65-5b50-4a60-898c-b56cb72d721b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-quobyte-c79d3b65-5b50-4a60-898c-b56cb72d721b" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-c79d3b65-5b50-4a60-898c-b56cb72d721b" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b92b36-0335-4ceb-9238-bf612d4c67fa]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:48 devstack sudo[110095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b Jun 23 12:55:48 devstack sudo[110095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-25089b77-c93f-477e-ab23-aa2a02afb37c-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-25089b77-c93f-477e-ab23-aa2a02afb37c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "cinder-quobyte-25089b77-c93f-477e-ab23-aa2a02afb37c" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-25089b77-c93f-477e-ab23-aa2a02afb37c" acquired by "delete_volume" :: waited 0.037s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e0d20b-e06d-4e22-b6ff-00714eec0768]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:48 devstack sudo[110091]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.854s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:48 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Deleted volume successfully. Jun 23 12:55:48 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.021s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:48 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Deleted volume successfully. Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-05427a12-b0ee-4d7c-a8e7-f31e6c913888 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-80f55089-ef4a-47e3-90b0-136581fafe2f-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4a04f77b-d7b5-4d05-babd-8f4be369a714 tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-561cfa11-44bf-4cd3-aa55-281e1db1e16b-delete_volume" released by "delete_volume" :: held 3.033s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:48 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c Jun 23 12:55:48 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:48 devstack sudo[110095]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b" returned: 0 in 1.023s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:49 devstack sudo[110104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b Jun 23 12:55:49 devstack sudo[110104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:49 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c" returned: 0 in 0.794s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:49 devstack sudo[110109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c Jun 23 12:55:49 devstack sudo[110109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:49 devstack sudo[110104]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c79d3b65-5b50-4a60-898c-b56cb72d721b" returned: 0 in 0.687s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-c79d3b65-5b50-4a60-898c-b56cb72d721b" released by "delete_volume" :: held 1.806s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Created reservations ['eb68c878-1960-48a6-87e5-a3b344633141', 'cd2e4dae-6319-4250-815d-b8c43a00e185', '779697b6-e805-4ce7-a9ba-c193719c381f', 'ce67d620-c5d9-40cb-bc08-4d3278518166'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:49 devstack sudo[110109]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-25089b77-c93f-477e-ab23-aa2a02afb37c" returned: 0 in 0.636s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:49 devstack sudo[110113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:49 devstack sudo[110113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-quobyte-25089b77-c93f-477e-ab23-aa2a02afb37c" released by "delete_volume" :: held 1.534s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Created reservations ['0aca7616-b172-4d95-9426-ec01d87009e5', 'f7a46227-cfbe-4e34-810c-c5874196dc56', '2569b61a-55ed-4aba-a8ff-7ed2e883d9f0', '40218bbc-f9cf-40fd-acbe-7756af506be4'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:50 devstack sudo[110115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:50 devstack sudo[110115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-0064e88d-0422-4c25-9042-622b90ad139e-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-0064e88d-0422-4c25-9042-622b90ad139e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-quobyte-0064e88d-0422-4c25-9042-622b90ad139e" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-0064e88d-0422-4c25-9042-622b90ad139e" acquired by "delete_volume" :: waited 0.029s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5897d3d2-cbd7-45e2-83dd-4d609f90d74c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:50 devstack sudo[110117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e Jun 23 12:55:50 devstack sudo[110117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:50 devstack sudo[110113]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.682s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Deleted volume successfully. Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a8d5fc83-de8a-4551-a3f2-71e06433a7cf tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-c79d3b65-5b50-4a60-898c-b56cb72d721b-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:50 devstack sudo[110115]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.805s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Deleted volume successfully. Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44a7ac94-8001-4709-8d1c-2d7b502f1838 tempest-VolumesSnapshotTestJSON-222993235 None] Lock "cinder-25089b77-c93f-477e-ab23-aa2a02afb37c-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:50 devstack sudo[110117]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e" returned: 0 in 0.799s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:51 devstack sudo[110124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e Jun 23 12:55:51 devstack sudo[110124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:51 devstack sudo[110124]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-0064e88d-0422-4c25-9042-622b90ad139e" returned: 0 in 0.670s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-0064e88d-0422-4c25-9042-622b90ad139e" released by "delete_volume" :: held 1.529s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Created reservations ['5a97d212-8695-4569-8566-7df9c9eab77a', '5237a9a1-e937-4a99-bf5e-35b9e26833c3', '20a5b483-c2c9-4d25-8d16-09f771862791', '4c247b43-c1b1-4f14-9429-4b29c05b9289'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:51 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:51 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-a32b3b3e-fd30-481c-97c8-2b06217d05ae-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-a32b3b3e-fd30-481c-97c8-2b06217d05ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "cinder-quobyte-a32b3b3e-fd30-481c-97c8-2b06217d05ae" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-a32b3b3e-fd30-481c-97c8-2b06217d05ae" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7d86ac-f010-4eb4-a372-ade1c1f79ded]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:52 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.670s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:52 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Deleted volume successfully. Jun 23 12:55:52 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5909c9d3-a2a7-452f-9162-25be833b608e tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-0064e88d-0422-4c25-9042-622b90ad139e-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:52 devstack sudo[110131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae Jun 23 12:55:52 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:53 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae" returned: 0 in 0.819s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:53 devstack sudo[110137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae Jun 23 12:55:53 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:53 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a32b3b3e-fd30-481c-97c8-2b06217d05ae" returned: 0 in 0.686s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:53 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-quobyte-a32b3b3e-fd30-481c-97c8-2b06217d05ae" released by "delete_volume" :: held 1.553s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Created reservations ['57c48434-18c8-4b24-bcdb-3a7e62cfc510', '5683ad04-3eba-4c39-892b-e12054b17658', 'ccadc288-b3f9-4ef6-aed2-339cd1183ce8', '597ce0c6-c886-4f50-a4c7-7651f05b1b0f'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:55:54 devstack sudo[110140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:55:54 devstack sudo[110140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:55:54 devstack sudo[110140]: pam_unix(sudo:session): session closed for user root Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.662s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:55:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Deleted volume successfully. Jun 23 12:55:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8e858785-5944-41b3-903b-0ea4ebc4851b tempest-CreateVolumesFromImageTest-1381838956 None] Lock "cinder-a32b3b3e-fd30-481c-97c8-2b06217d05ae-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Flow 'volume_create_manager' (63e3a110-6b6a-4ffc-af11-a1791ea426e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68905fdc-ca61-434c-87e7-5bfdb0612618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68905fdc-ca61-434c-87e7-5bfdb0612618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248823274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ca361-08c0-40dd-95dd-e505cf3f5fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51bc96f85684924b94a658f76760c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:56:03Z,use_quota=True,user_id='d8179b4ef94d42c8b98d671f37f5d03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc4ee51-cd48-4231-9873-315754107837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc4ee51-cd48-4231-9873-315754107837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ebaab-e0c4-4af1-86f6-0cce404d1817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37ebaab-e0c4-4af1-86f6-0cce404d1817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '730ca361-08c0-40dd-95dd-e505cf3f5fff', 'volume_name': 'volume-730ca361-08c0-40dd-95dd-e505cf3f5fff', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d11617-ba1d-4bee-93a2-6f55af654398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d11617-ba1d-4bee-93a2-6f55af654398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299b857c-5ad5-40e0-a336-36f3b3779944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:02 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Volume 730ca361-08c0-40dd-95dd-e505cf3f5fff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-730ca361-08c0-40dd-95dd-e505cf3f5fff', 'volume_size': 1} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-248823274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=730ca361-08c0-40dd-95dd-e505cf3f5fff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51bc96f85684924b94a658f76760c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:56:03Z,use_quota=True,user_id='d8179b4ef94d42c8b98d671f37f5d03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Creating volume 730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:56:02 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:56:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:02 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff 1073741824 Jun 23 12:56:02 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:03 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff 1073741824" returned: 0 in 0.981s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:03 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=139,cinder:SELECT=110,cinder:INSERT=38,cinder:DELETE=12 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:56:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:03 devstack sudo[110151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff Jun 23 12:56:03 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:04 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff" returned: 0 in 0.719s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299b857c-5ad5-40e0-a336-36f3b3779944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-730ca361-08c0-40dd-95dd-e505cf3f5fff', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54608dc2-4a85-4daf-bc1a-46a53180b86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:04 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Volume volume-730ca361-08c0-40dd-95dd-e505cf3f5fff (730ca361-08c0-40dd-95dd-e505cf3f5fff): created successfully Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54608dc2-4a85-4daf-bc1a-46a53180b86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Flow 'volume_create_manager' (63e3a110-6b6a-4ffc-af11-a1791ea426e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:56:04 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d2c85e42-ddf2-49e9-9706-d93398d9aa09 tempest-VolumeDependencyTests-59895526 None] Created volume successfully. Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Creating offline snapshot b9dea949-5ace-497e-9d9c-cf1abaca0d96 of volume 730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d261816-e4e5-4181-96bd-1af87fcc471a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:05 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff Jun 23 12:56:05 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:05 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff" returned: 0 in 0.990s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:05 devstack sudo[110167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 1G Jun 23 12:56:05 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:06 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 1G" returned: 0 in 0.910s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-730ca361-08c0-40dd-95dd-e505cf3f5fff -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:06 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-730ca361-08c0-40dd-95dd-e505cf3f5fff -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 Jun 23 12:56:06 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9f70b8f6-0145-4aaa-aac6-cf5e2bf9c11c req-221b87b0-908f-48fc-92fc-61f58737fae3 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:07 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-730ca361-08c0-40dd-95dd-e505cf3f5fff -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96" returned: 0 in 1.001s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:07 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 is being set with open permissions: ugo+rw Jun 23 12:56:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:07 devstack sudo[110187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 Jun 23 12:56:07 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:08 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96" returned: 0 in 0.653s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:08 devstack sudo[110190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.info Jun 23 12:56:08 devstack sudo[110190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:09 devstack sudo[110190]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.info" returned: 0 in 0.706s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:09 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.info is being set with open permissions: ugo+rw Jun 23 12:56:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:09 devstack sudo[110193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.info Jun 23 12:56:09 devstack sudo[110193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:09 devstack sudo[110193]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.info" returned: 0 in 0.704s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.065s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9f70b8f6-0145-4aaa-aac6-cf5e2bf9c11c req-221b87b0-908f-48fc-92fc-61f58737fae3 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.153s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:09 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bad049-3008-49af-bfa1-71dbb9a8482a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9f70b8f6-0145-4aaa-aac6-cf5e2bf9c11c req-221b87b0-908f-48fc-92fc-61f58737fae3 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5e0652fc-19df-4ec7-aecb-e619cb103a4c tempest-VolumeDependencyTests-59895526 None] Create snapshot completed successfully Jun 23 12:56:10 devstack sudo[110196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 Jun 23 12:56:10 devstack sudo[110196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Flow 'volume_create_manager' (c4f0f019-0f4e-4b7a-8cb2-db1ac75bf5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e58f809-760c-4aa2-b9a2-2d0b9300a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e58f809-760c-4aa2-b9a2-2d0b9300a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2142191467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd45ed42-35c9-4e91-a991-e8ca4fe4d496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51bc96f85684924b94a658f76760c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b9dea949-5ace-497e-9d9c-cf1abaca0d96,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:56:11Z,use_quota=True,user_id='d8179b4ef94d42c8b98d671f37f5d03e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b56dfd8-60a4-402a-9880-2a9f84b83a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b56dfd8-60a4-402a-9880-2a9f84b83a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f961f48-7fca-43a8-b218-be1f8b533670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f961f48-7fca-43a8-b218-be1f8b533670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd45ed42-35c9-4e91-a991-e8ca4fe4d496', 'volume_name': 'volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496', 'volume_size': 1, 'snapshot_id': 'b9dea949-5ace-497e-9d9c-cf1abaca0d96'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e3cb0e-3c02-47af-a92a-c6b3dbe5f8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:10 devstack sudo[110196]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96e3cb0e-3c02-47af-a92a-c6b3dbe5f8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe6e4e7-fa80-4c8a-a058-1aa9bd627529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:10 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Volume dd45ed42-35c9-4e91-a991-e8ca4fe4d496: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496', 'volume_size': 1, 'snapshot_id': 'b9dea949-5ace-497e-9d9c-cf1abaca0d96'} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-9f70b8f6-0145-4aaa-aac6-cf5e2bf9c11c req-221b87b0-908f-48fc-92fc-61f58737fae3 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789" returned: 0 in 0.932s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-9f70b8f6-0145-4aaa-aac6-cf5e2bf9c11c req-221b87b0-908f-48fc-92fc-61f58737fae3 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.957s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-quobyte-b9dea949-5ace-497e-9d9c-cf1abaca0d96-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-b9dea949-5ace-497e-9d9c-cf1abaca0d96-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Creating volume dd45ed42-35c9-4e91-a991-e8ca4fe4d496 from snapshot b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-quobyte-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-9f70b8f6-0145-4aaa-aac6-cf5e2bf9c11c req-221b87b0-908f-48fc-92fc-61f58737fae3 tempest-TestInstancesWithCinderVolumes-1855259179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-941c4d81-6952-4679-bbd7-c804aaa13789', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f427920a-e1de-4c2e-975e-88ae73e87735', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] snapshot: b9dea949-5ace-497e-9d9c-cf1abaca0d96, volume: dd45ed42-35c9-4e91-a991-e8ca4fe4d496, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d8a520-7018-4f74-8bb4-4c9e8298b772]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-9f70b8f6-0145-4aaa-aac6-cf5e2bf9c11c req-221b87b0-908f-48fc-92fc-61f58737fae3 tempest-TestInstancesWithCinderVolumes-1855259179 None] attachment_update completed successfully. Jun 23 12:56:11 devstack sudo[110203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 Jun 23 12:56:11 devstack sudo[110203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:11 devstack sudo[110203]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-730ca361-08c0-40dd-95dd-e505cf3f5fff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b1514-59a1-495b-b5e5-2ad9dc50d48f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:12 devstack sudo[110246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff Jun 23 12:56:12 devstack sudo[110246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:13 devstack sudo[110246]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff" returned: 0 in 1.027s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:13 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 12:56:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:13 devstack sudo[110254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 Jun 23 12:56:13 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:18 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" returned: 0 in 5.565s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99b9c5-c6a4-4144-856d-9afa52679273]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:18 devstack sudo[110277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff Jun 23 12:56:18 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:19 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff" returned: 0 in 1.229s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:19 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 12:56:19 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Converted 1024.00 MB image at 183.97 MB/s Jun 23 12:56:19 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 is being set with open permissions: ugo+rw Jun 23 12:56:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:19 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 Jun 23 12:56:19 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=78,cinder:UPDATE=91,cinder:INSERT=21,cinder:DELETE=9 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-46f5ddbd-f928-4c63-b873-c9eab95a151c req-caa6a944-2bd9-4c5d-8d17-0f16310fe1dd tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:20 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" returned: 0 in 0.743s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" released by "_copy_volume_from_snapshot" :: held 9.602s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-b9dea949-5ace-497e-9d9c-cf1abaca0d96-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" released by "_create_volume_from_snapshot" :: held 9.651s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.672s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-46f5ddbd-f928-4c63-b873-c9eab95a151c req-caa6a944-2bd9-4c5d-8d17-0f16310fe1dd tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.106s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7253643e-0658-4858-b696-be2e09c69716]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-46f5ddbd-f928-4c63-b873-c9eab95a151c req-caa6a944-2bd9-4c5d-8d17-0f16310fe1dd tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe6e4e7-fa80-4c8a-a058-1aa9bd627529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496', 'volume_size': 1, 'snapshot_id': 'b9dea949-5ace-497e-9d9c-cf1abaca0d96'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2586ccc0-a720-4c49-bc8b-220618b5d9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:56:20 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Volume volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 (dd45ed42-35c9-4e91-a991-e8ca4fe4d496): created successfully Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2586ccc0-a720-4c49-bc8b-220618b5d9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Flow 'volume_create_manager' (c4f0f019-0f4e-4b7a-8cb2-db1ac75bf5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:56:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e5fa00b0-0881-433c-9bba-b448e05e6481 tempest-VolumeDependencyTests-59895526 None] Created volume successfully. Jun 23 12:56:20 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 Jun 23 12:56:20 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-b9dea949-5ace-497e-9d9c-cf1abaca0d96-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-b9dea949-5ace-497e-9d9c-cf1abaca0d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-quobyte-730ca361-08c0-40dd-95dd-e505cf3f5fff" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-730ca361-08c0-40dd-95dd-e505cf3f5fff" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-quobyte-b9dea949-5ace-497e-9d9c-cf1abaca0d96" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-b9dea949-5ace-497e-9d9c-cf1abaca0d96" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Deleting offline snapshot b9dea949-5ace-497e-9d9c-cf1abaca0d96 of volume 730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] snapshot_file for this snap is: volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[4454b39c-8cd0-441c-b2ac-944114852b3a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:21 devstack sudo[110296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 Jun 23 12:56:21 devstack sudo[110296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:21 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-46f5ddbd-f928-4c63-b873-c9eab95a151c req-caa6a944-2bd9-4c5d-8d17-0f16310fe1dd tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-46f5ddbd-f928-4c63-b873-c9eab95a151c req-caa6a944-2bd9-4c5d-8d17-0f16310fe1dd tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.917s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:21 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-46f5ddbd-f928-4c63-b873-c9eab95a151c req-caa6a944-2bd9-4c5d-8d17-0f16310fe1dd tempest-TestInstancesWithCinderVolumes-1855259179 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bfa337fe-19eb-4537-a971-35cff8dd3ead', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:56:21 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-46f5ddbd-f928-4c63-b873-c9eab95a151c req-caa6a944-2bd9-4c5d-8d17-0f16310fe1dd tempest-TestInstancesWithCinderVolumes-1855259179 None] attachment_update completed successfully. Jun 23 12:56:22 devstack sudo[110296]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96" returned: 0 in 0.984s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-730ca361-08c0-40dd-95dd-e505cf3f5fff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0604e05-19de-47f9-84fb-79e08a1aa6dd]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:22 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff Jun 23 12:56:22 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:22 devstack sudo[110306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:56:22 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:23 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.795s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:56:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:56:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:56:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:56:23 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff" returned: 0 in 1.007s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:23 devstack sudo[110317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 Jun 23 12:56:23 devstack sudo[110317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:24 devstack sudo[110317]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96" returned: 0 in 0.972s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:24 devstack sudo[110323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96 Jun 23 12:56:24 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:24 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff.b9dea949-5ace-497e-9d9c-cf1abaca0d96" returned: 0 in 0.685s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-b9dea949-5ace-497e-9d9c-cf1abaca0d96" released by "_delete_snapshot" :: held 3.772s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-730ca361-08c0-40dd-95dd-e505cf3f5fff" released by "delete_snapshot" :: held 3.802s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:24 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Created reservations ['ee7ff381-0d8c-4457-bead-57b61a93771f', 'aaeb5714-ef19-456b-ae61-9bcb9a91494c', '13f0f3f2-4877-4da2-aa01-6b93345b43b2', '75cfbc1d-37da-4375-a847-8367147ba188'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:56:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Delete snapshot completed successfully. Jun 23 12:56:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-04ef3e25-5f21-40f8-8ee8-7036edd936b5 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-b9dea949-5ace-497e-9d9c-cf1abaca0d96-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-730ca361-08c0-40dd-95dd-e505cf3f5fff-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-730ca361-08c0-40dd-95dd-e505cf3f5fff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-quobyte-730ca361-08c0-40dd-95dd-e505cf3f5fff" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-730ca361-08c0-40dd-95dd-e505cf3f5fff" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:25 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5003a5b2-d31e-4065-8ee3-e03304355e15]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:25 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff Jun 23 12:56:25 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:26 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff" returned: 0 in 0.838s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:26 devstack sudo[110331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff Jun 23 12:56:26 devstack sudo[110331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:27 devstack sudo[110331]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-730ca361-08c0-40dd-95dd-e505cf3f5fff" returned: 0 in 0.835s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-730ca361-08c0-40dd-95dd-e505cf3f5fff" released by "delete_volume" :: held 1.748s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Created reservations ['3a251e35-79d7-4ab4-896d-17f1a0f1dbac', 'd8284948-089a-4ea9-9910-09e9261a90d6', '9c382b6a-aa1a-4e67-9593-c5b12f071c9e', 'f3084795-e762-4dd7-af5d-12c1743cc5ca'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:27 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:56:27 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-dd45ed42-35c9-4e91-a991-e8ca4fe4d496-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-dd45ed42-35c9-4e91-a991-e8ca4fe4d496-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "cinder-quobyte-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01bcf7-e519-401c-aa16-32368cbb13ab]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:27 devstack sudo[110351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 Jun 23 12:56:27 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:28 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.834s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:28 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:56:28 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Deleted volume successfully. Jun 23 12:56:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4b1b923d-84d5-4941-881c-103ec78420b4 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-730ca361-08c0-40dd-95dd-e505cf3f5fff-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:28 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" returned: 0 in 0.951s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:28 devstack sudo[110357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496 Jun 23 12:56:28 devstack sudo[110357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:29 devstack sudo[110357]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" returned: 0 in 0.742s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-quobyte-dd45ed42-35c9-4e91-a991-e8ca4fe4d496" released by "delete_volume" :: held 1.746s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Created reservations ['ec0f79d9-7ce6-4b56-8b9f-7628ab48324b', 'b8522608-67c7-47c2-a35a-3c9a2a53d6c6', 'ba51c65e-a187-4855-a17b-dddc985096e2', '8d02560b-5987-441c-b0be-af10e9c8cb37'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:29 devstack sudo[110369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:56:29 devstack sudo[110369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:30 devstack sudo[110369]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.786s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:30 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:56:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Deleted volume successfully. Jun 23 12:56:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-fba6db79-699c-4759-bd7f-6c8ab1e2a8e3 tempest-VolumeDependencyTests-59895526 None] Lock "cinder-dd45ed42-35c9-4e91-a991-e8ca4fe4d496-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-3d8be3e4-bf40-4350-8569-baabf9d05f6e req-f04693b0-20d1-49ab-bdd4-8e12fd72371b tempest-TestInstancesWithCinderVolumes-1855259179 None] Terminate volume connection completed successfully. Jun 23 12:56:32 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-3d8be3e4-bf40-4350-8569-baabf9d05f6e req-f04693b0-20d1-49ab-bdd4-8e12fd72371b tempest-TestInstancesWithCinderVolumes-1855259179 None] Deleting attachment f427920a-e1de-4c2e-975e-88ae73e87735. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:56:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "cinder-941c4d81-6952-4679-bbd7-c804aaa13789-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-941c4d81-6952-4679-bbd7-c804aaa13789-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "cinder-quobyte-941c4d81-6952-4679-bbd7-c804aaa13789" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-quobyte-941c4d81-6952-4679-bbd7-c804aaa13789" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742683b-e4b1-45a4-a903-abe6d21148ba]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:34 devstack sudo[110398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 Jun 23 12:56:34 devstack sudo[110398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:34 devstack sudo[110398]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789" returned: 0 in 0.761s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:34 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789 Jun 23 12:56:34 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:35 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-941c4d81-6952-4679-bbd7-c804aaa13789" returned: 0 in 0.710s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-quobyte-941c4d81-6952-4679-bbd7-c804aaa13789" released by "delete_volume" :: held 1.515s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:35 devstack cinder-volume[93659]: WARNING cinder.quota [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1547612018-203614608 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1547612018-203614608, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:56:35 devstack cinder-volume[93659]: WARNING cinder.quota [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1547612018-203614608 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1547612018-203614608, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Created reservations ['993bd07f-d725-4484-94bd-a51ea9e9d602', 'b615ea55-bea0-47c2-9f86-5a4abd079d05', 'e00b9a31-186e-451b-9774-80fe22180b8c', '05d63225-6ce2-4b83-b78c-a4e13467e3c5'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:35 devstack sudo[110406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:56:35 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:36 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.692s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:36 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:56:36 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deleted volume successfully. Jun 23 12:56:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-412ddb16-a799-4109-8c09-0c259e1cdb89 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-941c4d81-6952-4679-bbd7-c804aaa13789-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-c3dde4b5-a44c-4c33-b054-479d79349aed req-b03368dd-8e6e-4909-ba08-256d07b4e077 tempest-TestInstancesWithCinderVolumes-1855259179 None] Terminate volume connection completed successfully. Jun 23 12:56:38 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-c3dde4b5-a44c-4c33-b054-479d79349aed req-b03368dd-8e6e-4909-ba08-256d07b4e077 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deleting attachment bfa337fe-19eb-4537-a971-35cff8dd3ead. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:56:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "cinder-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "cinder-quobyte-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-quobyte-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:40 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ad8541-12d1-4fc1-944b-d3c5362bb320]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:40 devstack sudo[110454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 Jun 23 12:56:40 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:41 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63" returned: 0 in 0.819s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:41 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63 Jun 23 12:56:41 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:42 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63" returned: 0 in 0.727s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-quobyte-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63" released by "delete_volume" :: held 1.609s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:42 devstack cinder-volume[93659]: WARNING cinder.quota [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140529170-18944110 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140529170-18944110, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:56:42 devstack cinder-volume[93659]: WARNING cinder.quota [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140529170-18944110 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1140529170-18944110, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Created reservations ['d16b30de-1322-4565-973b-8ea9f8a275dd', 'df1be002-c313-4cd7-b1ec-886fbfaef6f3', '9e25d6e8-06ea-4a92-9241-20b7c467e5bc', '9cdb0776-3461-4ec5-a67b-3527ddce97ad'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:42 devstack sudo[110468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:56:42 devstack sudo[110468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:43 devstack sudo[110468]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.710s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:43 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:56:43 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deleted volume successfully. Jun 23 12:56:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ddd4d00-a5bf-4963-87cc-554b0d78b6d4 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-3e32d1d3-8b8e-4d1a-8c6e-fe786f5f6d63-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:47 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-1714eeb6-99c5-4792-a54e-bae3b0713ff3 req-0ec1b99c-02f3-4f43-9471-19a7e355f8ca tempest-TestInstancesWithCinderVolumes-1855259179 None] Terminate volume connection completed successfully. Jun 23 12:56:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-1714eeb6-99c5-4792-a54e-bae3b0713ff3 req-0ec1b99c-02f3-4f43-9471-19a7e355f8ca tempest-TestInstancesWithCinderVolumes-1855259179 None] Deleting attachment d5a05cd1-71b0-4986-9b15-d705091bf307. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "cinder-ae694e72-149a-407e-b126-8a01a75767cf-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-ae694e72-149a-407e-b126-8a01a75767cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "cinder-quobyte-ae694e72-149a-407e-b126-8a01a75767cf" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-quobyte-ae694e72-149a-407e-b126-8a01a75767cf" acquired by "delete_volume" :: waited 0.034s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88151a9-7a55-411d-8e58-e221d32c20b0]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:51 devstack sudo[110599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:56:51 devstack sudo[110599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:51 devstack sudo[110599]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 0 in 0.737s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:52 devstack sudo[110604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:56:52 devstack sudo[110604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:52 devstack sudo[110604]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 1 in 0.772s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 12:56:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:52 devstack sudo[110609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf Jun 23 12:56:52 devstack sudo[110609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:53 devstack sudo[110609]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ae694e72-149a-407e-b126-8a01a75767cf" returned: 0 in 0.646s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-quobyte-ae694e72-149a-407e-b126-8a01a75767cf" released by "delete_volume" :: held 2.229s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:56:53 devstack cinder-volume[93659]: WARNING cinder.quota [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1718364464-104653136 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1718364464-104653136, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:56:53 devstack cinder-volume[93659]: WARNING cinder.quota [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1718364464-104653136 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1718364464-104653136, it is now deprecated. Please use the default quota class for default quota. Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Created reservations ['cb02a8f7-fa40-40ba-adfb-c72293afbf8a', 'e2e63554-a5a9-44ba-b4b3-ad631211c3d2', '97731216-2f8e-4c53-8bf5-bd5ce7ed2d1b', 'a9f79aaa-1551-40e3-9071-8bb031bc7d47'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:56:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:56:53 devstack sudo[110612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:56:53 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:56:54 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root Jun 23 12:56:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.674s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:56:54 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:56:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Deleted volume successfully. Jun 23 12:56:54 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5f89653f-7d90-4778-b765-e80224869e61 tempest-TestInstancesWithCinderVolumes-1855259179 None] Lock "cinder-ae694e72-149a-407e-b126-8a01a75767cf-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:57:03 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=57,cinder:SELECT=51,cinder:INSERT=14,cinder:DELETE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:57:04 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=37,cinder:UPDATE=47,cinder:INSERT=11,cinder:DELETE=5 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:57:09 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Flow 'volume_create_manager' (d7a35086-c48e-43b8-a8ec-8bc26e38a280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cc0278-217f-4f91-ac66-69af5943e2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99cc0278-217f-4f91-ac66-69af5943e2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2048880271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edfe88a-73d6-4015-b66b-4c46e167fc1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a53ff6c9a44a9f9549429f634bc7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:10Z,use_quota=True,user_id='cdd00493988f49a2971f719abbbd656f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5332ae7c-c499-40c0-a659-aee12b1fa572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5332ae7c-c499-40c0-a659-aee12b1fa572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df051553-54bc-4ced-b7bd-11e2557f0a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df051553-54bc-4ced-b7bd-11e2557f0a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7edfe88a-73d6-4015-b66b-4c46e167fc1d', 'volume_name': 'volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2324fda2-9f93-4fd0-8507-637de171047d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2324fda2-9f93-4fd0-8507-637de171047d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4428f16d-7be2-4062-873d-b14855b5475f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:10 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Volume 7edfe88a-73d6-4015-b66b-4c46e167fc1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d', 'volume_size': 1} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2048880271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edfe88a-73d6-4015-b66b-4c46e167fc1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a53ff6c9a44a9f9549429f634bc7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:10Z,use_quota=True,user_id='cdd00493988f49a2971f719abbbd656f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Creating volume 7edfe88a-73d6-4015-b66b-4c46e167fc1d {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:57:10 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:57:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:10 devstack sudo[110641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d 1073741824 Jun 23 12:57:10 devstack sudo[110641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:11 devstack sudo[110641]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d 1073741824" returned: 0 in 1.055s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:11 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d Jun 23 12:57:11 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:11 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d" returned: 0 in 0.731s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4428f16d-7be2-4062-873d-b14855b5475f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d27d425-f811-411c-9044-102a3af202ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Volume volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d (7edfe88a-73d6-4015-b66b-4c46e167fc1d): created successfully Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d27d425-f811-411c-9044-102a3af202ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Flow 'volume_create_manager' (d7a35086-c48e-43b8-a8ec-8bc26e38a280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-76d431cd-95c2-4514-9712-e91a56f843ef tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Created volume successfully. Jun 23 12:57:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-4a1a6a40-ace6-48be-a9d0-d21139a0f16f req-90cef7a5-604e-435c-9fc0-39a669c057f7 tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-4a1a6a40-ace6-48be-a9d0-d21139a0f16f req-90cef7a5-604e-435c-9fc0-39a669c057f7 tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:16 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0bb51b-e381-4ab9-b69e-549be4862141]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:57:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-4a1a6a40-ace6-48be-a9d0-d21139a0f16f req-90cef7a5-604e-435c-9fc0-39a669c057f7 tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:16 devstack sudo[110697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d Jun 23 12:57:16 devstack sudo[110697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:17 devstack sudo[110697]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-4a1a6a40-ace6-48be-a9d0-d21139a0f16f req-90cef7a5-604e-435c-9fc0-39a669c057f7 tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d" returned: 0 in 0.800s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-4a1a6a40-ace6-48be-a9d0-d21139a0f16f req-90cef7a5-604e-435c-9fc0-39a669c057f7 tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.818s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-4a1a6a40-ace6-48be-a9d0-d21139a0f16f req-90cef7a5-604e-435c-9fc0-39a669c057f7 tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0dd8c90-01f1-4a4a-8eb5-a47c6aa64b0e', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:57:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-4a1a6a40-ace6-48be-a9d0-d21139a0f16f req-90cef7a5-604e-435c-9fc0-39a669c057f7 tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] attachment_update completed successfully. Jun 23 12:57:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:57:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:22 devstack sudo[111089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:57:22 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:23 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.909s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:57:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:57:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:57:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Flow 'volume_create_manager' (4b7dd515-9cc8-4d40-8d63-5686eb593477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615de9dc-6ab0-4c72-b9df-7edff6f969b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (615de9dc-6ab0-4c72-b9df-7edff6f969b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-301069257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cbd84f-9d92-4f32-8146-73d8e31cbaa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b2f97eca29347db9d3ff49ee0f9fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:24Z,use_quota=True,user_id='5dc705eb5a68424491b59fbbffeb27a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13be6b2-8e2b-4fd5-a409-edb06e1f515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13be6b2-8e2b-4fd5-a409-edb06e1f515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590b68bc-7554-4631-9dd0-824c4d20190d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590b68bc-7554-4631-9dd0-824c4d20190d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57cbd84f-9d92-4f32-8146-73d8e31cbaa9', 'volume_name': 'volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4547a5e-7c8e-4ac2-9c3f-a5cff873e371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4547a5e-7c8e-4ac2-9c3f-a5cff873e371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a1de17-7ee3-4c07-96d8-7a708e7dadd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Volume 57cbd84f-9d92-4f32-8146-73d8e31cbaa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9', 'volume_size': 1} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-301069257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57cbd84f-9d92-4f32-8146-73d8e31cbaa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b2f97eca29347db9d3ff49ee0f9fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:24Z,use_quota=True,user_id='5dc705eb5a68424491b59fbbffeb27a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Creating volume 57cbd84f-9d92-4f32-8146-73d8e31cbaa9 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:57:24 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:24 devstack sudo[111092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 1073741824 Jun 23 12:57:24 devstack sudo[111092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Flow 'volume_create_manager' (0ac50718-b946-4a53-80eb-9e308e8a2a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed00ce9f-afc3-4aaf-8ae7-92c6891d52f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed00ce9f-afc3-4aaf-8ae7-92c6891d52f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-369047860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d296ee35-e33a-4e17-a5c6-553b265f676b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b2f97eca29347db9d3ff49ee0f9fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:25Z,use_quota=True,user_id='5dc705eb5a68424491b59fbbffeb27a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e7c81f-1ca2-43a3-83d1-b329d777cb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e7c81f-1ca2-43a3-83d1-b329d777cb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fd6b25-00f5-4f23-8159-0639f3a12630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5fd6b25-00f5-4f23-8159-0639f3a12630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd296ee35-e33a-4e17-a5c6-553b265f676b', 'volume_name': 'volume-d296ee35-e33a-4e17-a5c6-553b265f676b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1de7d2-d362-449a-8858-385887c5edb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1de7d2-d362-449a-8858-385887c5edb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd97311c-5281-4a74-819d-314d83a465cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Volume d296ee35-e33a-4e17-a5c6-553b265f676b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d296ee35-e33a-4e17-a5c6-553b265f676b', 'volume_size': 1} Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-557ed528-bb7e-48c1-a249-1e8c2a0cf915 req-ed20bdd8-faf0-463e-91ba-1e141d06225c tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Terminate volume connection completed successfully. Jun 23 12:57:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-557ed528-bb7e-48c1-a249-1e8c2a0cf915 req-ed20bdd8-faf0-463e-91ba-1e141d06225c tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Deleting attachment d0dd8c90-01f1-4a4a-8eb5-a47c6aa64b0e. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:57:25 devstack sudo[111092]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 1073741824" returned: 0 in 1.120s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:25 devstack sudo[111128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 Jun 23 12:57:25 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:26 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9" returned: 0 in 0.721s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-369047860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d296ee35-e33a-4e17-a5c6-553b265f676b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b2f97eca29347db9d3ff49ee0f9fbe9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:25Z,use_quota=True,user_id='5dc705eb5a68424491b59fbbffeb27a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Creating volume d296ee35-e33a-4e17-a5c6-553b265f676b {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:57:26 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a1de17-7ee3-4c07-96d8-7a708e7dadd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:26 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b 1073741824 Jun 23 12:57:26 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d32785-d9f9-4481-b200-edfecee11bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Volume volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 (57cbd84f-9d92-4f32-8146-73d8e31cbaa9): created successfully Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55d32785-d9f9-4481-b200-edfecee11bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Flow 'volume_create_manager' (4b7dd515-9cc8-4d40-8d63-5686eb593477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:26 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-69c4f49c-b84b-4aa3-9490-53d6315ae09e tempest-TestServerVolumeAttachmentScenario-457363964 None] Created volume successfully. Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Acquiring lock "cinder-7edfe88a-73d6-4015-b66b-4c46e167fc1d-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "cinder-7edfe88a-73d6-4015-b66b-4c46e167fc1d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Acquiring lock "cinder-quobyte-7edfe88a-73d6-4015-b66b-4c46e167fc1d" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "cinder-quobyte-7edfe88a-73d6-4015-b66b-4c46e167fc1d" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4eeb84-e234-45f3-b712-7ae6538696b7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:57:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:27 devstack sudo[111135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d Jun 23 12:57:27 devstack sudo[111135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:27 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b 1073741824" returned: 0 in 1.115s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:27 devstack sudo[111139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b Jun 23 12:57:27 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:27 devstack sudo[111135]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d" returned: 0 in 0.903s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:27 devstack sudo[111151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d Jun 23 12:57:27 devstack sudo[111151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:28 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b" returned: 0 in 0.693s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd97311c-5281-4a74-819d-314d83a465cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d296ee35-e33a-4e17-a5c6-553b265f676b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7959e1-45bb-40cd-bd9e-314a445bf2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:28 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Volume volume-d296ee35-e33a-4e17-a5c6-553b265f676b (d296ee35-e33a-4e17-a5c6-553b265f676b): created successfully Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7959e1-45bb-40cd-bd9e-314a445bf2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Flow 'volume_create_manager' (0ac50718-b946-4a53-80eb-9e308e8a2a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:28 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9876bd6e-0708-41c3-8577-2191a2b65332 tempest-TestServerVolumeAttachmentScenario-457363964 None] Created volume successfully. Jun 23 12:57:28 devstack sudo[111151]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7edfe88a-73d6-4015-b66b-4c46e167fc1d" returned: 0 in 0.725s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "cinder-quobyte-7edfe88a-73d6-4015-b66b-4c46e167fc1d" released by "delete_volume" :: held 1.697s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Created reservations ['9839eb50-a545-447a-b6da-12f75217a661', '354c2306-7cc2-41cf-a837-1d66343240e7', 'ebc434ed-171e-4064-9fd8-b9f4aaac296a', '6cfa1ac6-c0fd-40cc-be33-fcd691bd7534'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:28 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:57:28 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:29 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.783s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:29 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:57:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Deleted volume successfully. Jun 23 12:57:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d721b627-62c5-4f6c-8d36-5a799f4ade8b tempest-TestServerVolumeAttachScenarioOldVersion-981657982 None] Lock "cinder-7edfe88a-73d6-4015-b66b-4c46e167fc1d-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:57:38 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=21,cinder:SELECT=17,cinder:INSERT=2 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:57:39 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=18,cinder:UPDATE=16,cinder:INSERT=5,cinder:DELETE=4 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (8b2fd7d4-bcfc-438b-9fd6-051d376988fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0427164e-3766-44a2-b679-606f3b296996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0427164e-3766-44a2-b679-606f3b296996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881902077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccd3c11-ca39-4617-9eba-ebcad6c2a5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:49Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844199a3-1d28-4b27-a181-7e6f9bdae580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844199a3-1d28-4b27-a181-7e6f9bdae580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddbe50b-51fe-48f9-90bf-99f5d96cfd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ddbe50b-51fe-48f9-90bf-99f5d96cfd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccd3c11-ca39-4617-9eba-ebcad6c2a5a5', 'volume_name': 'volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b3df24-79ec-4e6b-affb-79a6fb91c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b3df24-79ec-4e6b-affb-79a6fb91c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1289f29-fe01-4832-8c2b-140d2378ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:49 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume eccd3c11-ca39-4617-9eba-ebcad6c2a5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5', 'volume_size': 1} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1881902077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccd3c11-ca39-4617-9eba-ebcad6c2a5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:49Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Creating volume eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:57:49 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:57:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:49 devstack sudo[111323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 1073741824 Jun 23 12:57:49 devstack sudo[111323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:50 devstack sudo[111323]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 1073741824" returned: 0 in 0.818s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:50 devstack sudo[111328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 Jun 23 12:57:50 devstack sudo[111328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:50 devstack sudo[111328]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" returned: 0 in 0.620s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1289f29-fe01-4832-8c2b-140d2378ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c652a9-b05c-4ff7-a473-82efed7986fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:50 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 (eccd3c11-ca39-4617-9eba-ebcad6c2a5a5): created successfully Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42c652a9-b05c-4ff7-a473-82efed7986fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (8b2fd7d4-bcfc-438b-9fd6-051d376988fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-aa8eef97-b8a0-437a-a7f2-a849891a2256 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created volume successfully. Jun 23 12:57:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:51 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Creating offline snapshot e768462b-b31d-4f25-82cd-3f1362d2b4f4 of volume eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:57:51 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3276a153-9964-4fab-9534-ee296445495e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:57:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:51 devstack sudo[111332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 Jun 23 12:57:51 devstack sudo[111332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:52 devstack sudo[111332]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" returned: 0 in 0.749s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:52 devstack sudo[111337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 1G Jun 23 12:57:52 devstack sudo[111337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:53 devstack sudo[111337]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 1G" returned: 0 in 0.783s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:53 devstack sudo[111365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 Jun 23 12:57:53 devstack sudo[111365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:53 devstack sudo[111365]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4" returned: 0 in 0.693s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:53 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 is being set with open permissions: ugo+rw Jun 23 12:57:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:53 devstack sudo[111371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 Jun 23 12:57:53 devstack sudo[111371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:54 devstack sudo[111371]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4" returned: 0 in 0.615s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:54 devstack sudo[111374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.info Jun 23 12:57:54 devstack sudo[111374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:55 devstack sudo[111374]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.info" returned: 0 in 0.635s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:55 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.info is being set with open permissions: ugo+rw Jun 23 12:57:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:55 devstack sudo[111377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.info Jun 23 12:57:55 devstack sudo[111377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:55 devstack sudo[111377]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.info" returned: 0 in 0.664s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.227s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:55 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e8586bb5-e063-4dad-8d8e-5fda4e75a41f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Create snapshot completed successfully Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (7fae1a32-86ec-496e-b6eb-8b464a941d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7fa13c-1ee5-4e85-a819-3fa8e622162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7fa13c-1ee5-4e85-a819-3fa8e622162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1414404574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18789e1e-104a-450c-9351-bf8c76ed5f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:57Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a8e7b9-be04-42c2-b04a-4c16c691067c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1a8e7b9-be04-42c2-b04a-4c16c691067c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc4c8e1-4793-460a-a93c-8de776f0c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc4c8e1-4793-460a-a93c-8de776f0c887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18789e1e-104a-450c-9351-bf8c76ed5f01', 'volume_name': 'volume-18789e1e-104a-450c-9351-bf8c76ed5f01', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c27d1-01f8-4dbf-987c-1eba7134b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7c27d1-01f8-4dbf-987c-1eba7134b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8127e920-c00c-44db-a8a9-f1a2eb860808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume 18789e1e-104a-450c-9351-bf8c76ed5f01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18789e1e-104a-450c-9351-bf8c76ed5f01', 'volume_size': 1} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1414404574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18789e1e-104a-450c-9351-bf8c76ed5f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:57Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Creating volume 18789e1e-104a-450c-9351-bf8c76ed5f01 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:57:57 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:57 devstack sudo[111380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 1073741824 Jun 23 12:57:57 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (ca4f81f1-6c58-4677-8cf8-430af3fb9360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f02b50-4f38-449e-9574-c162b3e054b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f02b50-4f38-449e-9574-c162b3e054b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669340746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492ae1fa-8001-412e-90a6-a8d82983f2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:57Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c903ac-500d-4596-9453-5120338346b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98c903ac-500d-4596-9453-5120338346b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a086317-4dea-4874-befc-3b0415a0d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a086317-4dea-4874-befc-3b0415a0d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '492ae1fa-8001-412e-90a6-a8d82983f2e6', 'volume_name': 'volume-492ae1fa-8001-412e-90a6-a8d82983f2e6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b25d0a-bfd5-4ef3-b13b-fad0d06ed194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b25d0a-bfd5-4ef3-b13b-fad0d06ed194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e4f9da-7618-48a7-ae28-da923e4a76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume 492ae1fa-8001-412e-90a6-a8d82983f2e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-492ae1fa-8001-412e-90a6-a8d82983f2e6', 'volume_size': 1} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (03a0ac11-2e74-4397-a52b-b0d585aeb447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9251409-33ae-4be3-b98e-dae6cc928326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9251409-33ae-4be3-b98e-dae6cc928326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328353171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22966eed-3ad8-45e1-8616-e9415cca5be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:58Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca67587-bf78-4680-a5b6-1547c9f70de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca67587-bf78-4680-a5b6-1547c9f70de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdf9f0f-58bb-4010-a699-e7c755c3c134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdf9f0f-58bb-4010-a699-e7c755c3c134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22966eed-3ad8-45e1-8616-e9415cca5be5', 'volume_name': 'volume-22966eed-3ad8-45e1-8616-e9415cca5be5', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1b4973-8686-4217-a6ba-dc184f2be53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e1b4973-8686-4217-a6ba-dc184f2be53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1d0334-ee73-41d8-991c-fc77e1fa2f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume 22966eed-3ad8-45e1-8616-e9415cca5be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22966eed-3ad8-45e1-8616-e9415cca5be5', 'volume_size': 1} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:58 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 1073741824" returned: 0 in 0.976s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:58 devstack sudo[111387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 Jun 23 12:57:58 devstack sudo[111387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (31fb6402-1794-46b8-83bd-5ec7979cd0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b59cce-20aa-4d26-bf64-5caf5b9d6d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b59cce-20aa-4d26-bf64-5caf5b9d6d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137336888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2986c40-1d8e-4af8-a536-8b992bad66f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:58Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b054b2-4fe8-4d85-a0a7-e19c366ed6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b054b2-4fe8-4d85-a0a7-e19c366ed6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b707326e-57da-431d-8a97-b99251eebdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b707326e-57da-431d-8a97-b99251eebdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2986c40-1d8e-4af8-a536-8b992bad66f6', 'volume_name': 'volume-c2986c40-1d8e-4af8-a536-8b992bad66f6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a9a6f0-8d3d-41c8-862c-011f79062f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7a9a6f0-8d3d-41c8-862c-011f79062f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122ca0da-a9df-4782-b5e8-e0f611c0dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume c2986c40-1d8e-4af8-a536-8b992bad66f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2986c40-1d8e-4af8-a536-8b992bad66f6', 'volume_size': 1} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (9b9d757c-86f5-4fcf-946e-4f4622bb5c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087ac5bc-d0b2-4dc0-99c6-87f53b39e148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087ac5bc-d0b2-4dc0-99c6-87f53b39e148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317680208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7781b2d6-ed90-4299-bf96-dddbe4befe20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:59Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e511b7ce-0a81-49ae-845b-d21f3f087a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e511b7ce-0a81-49ae-845b-d21f3f087a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593ceac7-862d-45e8-a75e-77594ef43993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593ceac7-862d-45e8-a75e-77594ef43993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7781b2d6-ed90-4299-bf96-dddbe4befe20', 'volume_name': 'volume-7781b2d6-ed90-4299-bf96-dddbe4befe20', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451710ab-4d84-4e9a-ac30-50caab9da267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451710ab-4d84-4e9a-ac30-50caab9da267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef609037-7758-4b99-a7c9-91f003263188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume 7781b2d6-ed90-4299-bf96-dddbe4befe20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7781b2d6-ed90-4299-bf96-dddbe4befe20', 'volume_size': 1} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:58 devstack sudo[111387]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01" returned: 0 in 0.641s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1669340746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492ae1fa-8001-412e-90a6-a8d82983f2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:57Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Creating volume 492ae1fa-8001-412e-90a6-a8d82983f2e6 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:57:58 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:58 devstack sudo[111390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 1073741824 Jun 23 12:57:58 devstack sudo[111390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8127e920-c00c-44db-a8a9-f1a2eb860808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18789e1e-104a-450c-9351-bf8c76ed5f01', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b8625e-7ea9-46cf-8060-e4214e44e551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:57:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume volume-18789e1e-104a-450c-9351-bf8c76ed5f01 (18789e1e-104a-450c-9351-bf8c76ed5f01): created successfully Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b8625e-7ea9-46cf-8060-e4214e44e551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:57:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (7fae1a32-86ec-496e-b6eb-8b464a941d17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:57:58 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7fa2b825-68b8-431d-ab81-cde6bc79853e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created volume successfully. Jun 23 12:57:59 devstack sudo[111390]: pam_unix(sudo:session): session closed for user root Jun 23 12:57:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 1073741824" returned: 0 in 0.800s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:57:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:57:59 devstack sudo[111396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 Jun 23 12:57:59 devstack sudo[111396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:00 devstack sudo[111396]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6" returned: 0 in 0.615s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] <== create_volume: return (1452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.326s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-328353171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22966eed-3ad8-45e1-8616-e9415cca5be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:58Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Creating volume 22966eed-3ad8-45e1-8616-e9415cca5be5 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:58:00 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e4f9da-7618-48a7-ae28-da923e4a76cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492ae1fa-8001-412e-90a6-a8d82983f2e6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:00 devstack sudo[111399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 1073741824 Jun 23 12:58:00 devstack sudo[111399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9f0a8a-7772-4f94-8fd8-b7afe59ce443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 (492ae1fa-8001-412e-90a6-a8d82983f2e6): created successfully Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9f0a8a-7772-4f94-8fd8-b7afe59ce443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (ca4f81f1-6c58-4677-8cf8-430af3fb9360) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:00 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-15d70d50-ca93-47d4-bc05-e584dbf80a16 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created volume successfully. Jun 23 12:58:01 devstack sudo[111399]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 1073741824" returned: 0 in 0.861s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:01 devstack sudo[111405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 Jun 23 12:58:01 devstack sudo[111405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:01 devstack sudo[111405]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5" returned: 0 in 0.643s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.509s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-137336888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2986c40-1d8e-4af8-a536-8b992bad66f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:58Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Creating volume c2986c40-1d8e-4af8-a536-8b992bad66f6 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:58:01 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:01 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 1073741824 Jun 23 12:58:01 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1d0334-ee73-41d8-991c-fc77e1fa2f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22966eed-3ad8-45e1-8616-e9415cca5be5', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c197044-e5eb-410c-a6dd-4e16685a2aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume volume-22966eed-3ad8-45e1-8616-e9415cca5be5 (22966eed-3ad8-45e1-8616-e9415cca5be5): created successfully Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c197044-e5eb-410c-a6dd-4e16685a2aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (03a0ac11-2e74-4397-a52b-b0d585aeb447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-73e53c0a-1f84-4214-9fda-81e6effa889b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created volume successfully. Jun 23 12:58:02 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 1073741824" returned: 0 in 0.862s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:02 devstack sudo[111413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 Jun 23 12:58:02 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:03 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6" returned: 0 in 0.623s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.717s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-317680208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7781b2d6-ed90-4299-bf96-dddbe4befe20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576101c61442456491cc55a03af18cd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:57:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:57:59Z,use_quota=True,user_id='882e0871b4094b6b829434a2efbbe5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Creating volume 7781b2d6-ed90-4299-bf96-dddbe4befe20 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:58:03 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122ca0da-a9df-4782-b5e8-e0f611c0dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2986c40-1d8e-4af8-a536-8b992bad66f6', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:03 devstack sudo[111416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 1073741824 Jun 23 12:58:03 devstack sudo[111416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5d2903-caa1-4b84-9978-0ce62e117a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 (c2986c40-1d8e-4af8-a536-8b992bad66f6): created successfully Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5d2903-caa1-4b84-9978-0ce62e117a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (31fb6402-1794-46b8-83bd-5ec7979cd0bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5c2fadb9-818e-4618-8e25-952914aad5fb tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created volume successfully. Jun 23 12:58:04 devstack sudo[111416]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 1073741824" returned: 0 in 0.914s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:04 devstack sudo[111423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 Jun 23 12:58:04 devstack sudo[111423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:05 devstack sudo[111423]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20" returned: 0 in 0.616s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef609037-7758-4b99-a7c9-91f003263188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7781b2d6-ed90-4299-bf96-dddbe4befe20', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661b5901-ec7c-411a-adfa-97e95c0cc114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:05 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Volume volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 (7781b2d6-ed90-4299-bf96-dddbe4befe20): created successfully Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661b5901-ec7c-411a-adfa-97e95c0cc114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Flow 'volume_create_manager' (9b9d757c-86f5-4fcf-946e-4f4622bb5c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2f465e11-0a78-4d9b-bcfd-9c6fb1d8fc22 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created volume successfully. Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-7781b2d6-ed90-4299-bf96-dddbe4befe20-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-7781b2d6-ed90-4299-bf96-dddbe4befe20-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-7781b2d6-ed90-4299-bf96-dddbe4befe20" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-7781b2d6-ed90-4299-bf96-dddbe4befe20" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae2b76c-1686-4b3b-9072-a47ddfbdf371]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:05 devstack sudo[111429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 Jun 23 12:58:05 devstack sudo[111429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:06 devstack sudo[111429]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20" returned: 0 in 0.726s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:06 devstack sudo[111434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20 Jun 23 12:58:06 devstack sudo[111434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:06 devstack sudo[111434]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7781b2d6-ed90-4299-bf96-dddbe4befe20" returned: 0 in 0.655s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-7781b2d6-ed90-4299-bf96-dddbe4befe20" released by "delete_volume" :: held 1.434s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created reservations ['beb2bf80-b2b5-48a5-894e-cb048056ad96', 'd89de405-2f68-4982-a41d-86cdbdd33b34', '2f5997f7-ec9d-4423-aab2-04f23c2fb139', 'aa0f9244-3805-4c3c-8665-227bcc38c1df'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:06 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:06 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-c2986c40-1d8e-4af8-a536-8b992bad66f6-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:07 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.641s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-c2986c40-1d8e-4af8-a536-8b992bad66f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Deleted volume successfully. Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-29db44bd-11f3-4a51-953e-4f6948b4c32f tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-7781b2d6-ed90-4299-bf96-dddbe4befe20-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-c2986c40-1d8e-4af8-a536-8b992bad66f6" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-c2986c40-1d8e-4af8-a536-8b992bad66f6" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925336d-6f7d-4c1c-b06a-eff6a410e94c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-bff2d071-7c83-4289-a438-8aba0932e95a req-44c7caa9-877b-4e6b-9099-a41fa19ffe5d tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-bff2d071-7c83-4289-a438-8aba0932e95a req-44c7caa9-877b-4e6b-9099-a41fa19ffe5d tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[397a8c05-4979-4471-82c6-cab083c976b6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-bff2d071-7c83-4289-a438-8aba0932e95a req-44c7caa9-877b-4e6b-9099-a41fa19ffe5d tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:07 devstack sudo[111448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 Jun 23 12:58:07 devstack sudo[111448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:07 devstack sudo[111450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 Jun 23 12:58:07 devstack sudo[111450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:08 devstack sudo[111448]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6" returned: 0 in 0.745s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:08 devstack sudo[111459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6 Jun 23 12:58:08 devstack sudo[111459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:08 devstack sudo[111450]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-bff2d071-7c83-4289-a438-8aba0932e95a req-44c7caa9-877b-4e6b-9099-a41fa19ffe5d tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9" returned: 0 in 0.764s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-bff2d071-7c83-4289-a438-8aba0932e95a req-44c7caa9-877b-4e6b-9099-a41fa19ffe5d tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.782s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-bff2d071-7c83-4289-a438-8aba0932e95a req-44c7caa9-877b-4e6b-9099-a41fa19ffe5d tempest-TestServerVolumeAttachmentScenario-457363964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '422914d6-59be-4aaa-b9de-54c1c77ad222', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:58:08 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-bff2d071-7c83-4289-a438-8aba0932e95a req-44c7caa9-877b-4e6b-9099-a41fa19ffe5d tempest-TestServerVolumeAttachmentScenario-457363964 None] attachment_update completed successfully. Jun 23 12:58:08 devstack sudo[111459]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-c2986c40-1d8e-4af8-a536-8b992bad66f6" returned: 0 in 0.647s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-c2986c40-1d8e-4af8-a536-8b992bad66f6" released by "delete_volume" :: held 1.430s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created reservations ['817bc0d6-9aaa-4ec1-bb9f-9b9754014464', '80d71569-ef2f-4b99-a5e8-fa69d4f48fac', 'e999a077-4f87-46db-b421-80d07c22e6a5', '8ea22637-2a07-4522-afd4-bd19cbb21ead'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:09 devstack sudo[111529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:09 devstack sudo[111529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-22966eed-3ad8-45e1-8616-e9415cca5be5-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:09 devstack sudo[111529]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.670s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-22966eed-3ad8-45e1-8616-e9415cca5be5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Deleted volume successfully. Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0b333fca-82b5-444a-8b4f-77d46e1c0e0a tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-c2986c40-1d8e-4af8-a536-8b992bad66f6-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-22966eed-3ad8-45e1-8616-e9415cca5be5" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-22966eed-3ad8-45e1-8616-e9415cca5be5" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fc56a7-d05d-4c62-a4aa-f02da5bb4cce]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:09 devstack sudo[111850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 Jun 23 12:58:09 devstack sudo[111850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:10 devstack sudo[111850]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5" returned: 0 in 0.741s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:10 devstack sudo[111855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5 Jun 23 12:58:10 devstack sudo[111855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:11 devstack sudo[111855]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-22966eed-3ad8-45e1-8616-e9415cca5be5" returned: 0 in 0.652s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-22966eed-3ad8-45e1-8616-e9415cca5be5" released by "delete_volume" :: held 1.436s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created reservations ['5f5ea3d7-32ba-4de3-ae52-f0796da669c4', '09164013-7b29-45da-950b-5a6d6ad4c421', '72030d18-3369-4632-b950-417819669ef1', '4907cf38-5b55-413e-bf1d-6aaa2a4b5022'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:11 devstack sudo[111858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:11 devstack sudo[111858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-492ae1fa-8001-412e-90a6-a8d82983f2e6-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-492ae1fa-8001-412e-90a6-a8d82983f2e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-492ae1fa-8001-412e-90a6-a8d82983f2e6" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:12 devstack sudo[111858]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.680s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-492ae1fa-8001-412e-90a6-a8d82983f2e6" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Deleted volume successfully. Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[991b0cc9-13ff-4d3b-bcc9-72665178e12c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0450b392-c72a-4f25-b696-70df1dd3a66e tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-22966eed-3ad8-45e1-8616-e9415cca5be5-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:12 devstack sudo[111871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 Jun 23 12:58:12 devstack sudo[111871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6" returned: 0 in 0.838s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:12 devstack sudo[111871]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:12 devstack sudo[111903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6 Jun 23 12:58:12 devstack sudo[111903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:13 devstack sudo[111903]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-492ae1fa-8001-412e-90a6-a8d82983f2e6" returned: 0 in 0.647s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-492ae1fa-8001-412e-90a6-a8d82983f2e6" released by "delete_volume" :: held 1.529s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created reservations ['5845e343-de1b-4a46-932e-01f92606a8d1', '50603168-5f90-4bfe-8277-104fb618588a', '69e3d5ad-b2d3-4b01-a1d9-183de17b291f', 'ce8eebf3-ed1c-405a-9a67-04ceeeae6891'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:13 devstack sudo[111906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:13 devstack sudo[111906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:14 devstack sudo[111906]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.634s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:14 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Deleted volume successfully. Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5efc2980-5ac9-4493-932d-f5841d03ff4b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-492ae1fa-8001-412e-90a6-a8d82983f2e6-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-18789e1e-104a-450c-9351-bf8c76ed5f01-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-18789e1e-104a-450c-9351-bf8c76ed5f01-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-18789e1e-104a-450c-9351-bf8c76ed5f01" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-18789e1e-104a-450c-9351-bf8c76ed5f01" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf0d4f9-78ce-441d-8439-b9acd534db6a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:14 devstack sudo[111912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 Jun 23 12:58:14 devstack sudo[111912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:15 devstack sudo[111912]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01" returned: 0 in 0.732s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:15 devstack sudo[111917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01 Jun 23 12:58:15 devstack sudo[111917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:15 devstack sudo[111917]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-18789e1e-104a-450c-9351-bf8c76ed5f01" returned: 0 in 0.614s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-18789e1e-104a-450c-9351-bf8c76ed5f01" released by "delete_volume" :: held 1.390s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created reservations ['0cb93c3a-9c6c-4e76-abe6-81b685818725', 'e02bf39c-39ff-48f7-95c0-934f395d49d8', '5f07b865-9180-4981-b6f4-665f0171d47c', '059f1b99-50ad-48a4-b709-fcfec1673666'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:16 devstack sudo[111920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:16 devstack sudo[111920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:16 devstack sudo[111920]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.615s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:16 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Deleted volume successfully. Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-e768462b-b31d-4f25-82cd-3f1362d2b4f4-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44153963-68e2-4741-9f5d-4bf5be48563b tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-18789e1e-104a-450c-9351-bf8c76ed5f01-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-e768462b-b31d-4f25-82cd-3f1362d2b4f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-e768462b-b31d-4f25-82cd-3f1362d2b4f4" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-e768462b-b31d-4f25-82cd-3f1362d2b4f4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Deleting offline snapshot e768462b-b31d-4f25-82cd-3f1362d2b4f4 of volume eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] snapshot_file for this snap is: volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a765305e-405c-49f5-a326-52dfc51a1888]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:16 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 Jun 23 12:58:16 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-c1457aa4-c20f-48cd-bcbe-39458242e2a9 req-e53b4f21-cb57-45b7-8074-7afcb0bdcf36 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-c1457aa4-c20f-48cd-bcbe-39458242e2a9 req-e53b4f21-cb57-45b7-8074-7afcb0bdcf36 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e18989a-8abf-4dcb-a87b-c501aa15ab8e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-c1457aa4-c20f-48cd-bcbe-39458242e2a9 req-e53b4f21-cb57-45b7-8074-7afcb0bdcf36 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:17 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4" returned: 0 in 0.741s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2fa81f-4db7-44a3-9ce6-4860370c7a7d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:17 devstack sudo[111936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b Jun 23 12:58:17 devstack sudo[111936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:17 devstack sudo[111938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 Jun 23 12:58:17 devstack sudo[111938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:18 devstack sudo[111936]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-c1457aa4-c20f-48cd-bcbe-39458242e2a9 req-e53b4f21-cb57-45b7-8074-7afcb0bdcf36 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b" returned: 0 in 0.743s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-c1457aa4-c20f-48cd-bcbe-39458242e2a9 req-e53b4f21-cb57-45b7-8074-7afcb0bdcf36 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.759s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:18 devstack sudo[111938]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-c1457aa4-c20f-48cd-bcbe-39458242e2a9 req-e53b4f21-cb57-45b7-8074-7afcb0bdcf36 tempest-TestServerVolumeAttachmentScenario-457363964 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-d296ee35-e33a-4e17-a5c6-553b265f676b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bcb2489d-4af7-42fb-9af7-d599318e3d79', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:58:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" returned: 0 in 0.737s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:18 devstack sudo[111947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 Jun 23 12:58:18 devstack sudo[111947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-c1457aa4-c20f-48cd-bcbe-39458242e2a9 req-e53b4f21-cb57-45b7-8074-7afcb0bdcf36 tempest-TestServerVolumeAttachmentScenario-457363964 None] attachment_update completed successfully. Jun 23 12:58:19 devstack sudo[111947]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4" returned: 0 in 0.714s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:19 devstack sudo[111952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4 Jun 23 12:58:19 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:19 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5.e768462b-b31d-4f25-82cd-3f1362d2b4f4" returned: 0 in 0.631s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-e768462b-b31d-4f25-82cd-3f1362d2b4f4" released by "_delete_snapshot" :: held 2.926s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" released by "delete_snapshot" :: held 2.948s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created reservations ['f2ca94db-f42e-48bf-935d-e957a2aaa20c', '347be2e7-e4db-4064-a56c-e39439f1a263', 'cb7ca77a-a523-425a-a5dc-694dad5138b9', 'deda5137-8ffb-457c-9975-ffba4d310574'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Delete snapshot completed successfully. Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e2c146ab-b0cb-4cbd-8802-f764cc3340ae tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-e768462b-b31d-4f25-82cd-3f1362d2b4f4-delete_snapshot" released by "delete_snapshot" :: held 3.118s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "cinder-quobyte-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[520eb936-9141-47a9-b476-c3c2532b7372]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:20 devstack sudo[111960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 Jun 23 12:58:20 devstack sudo[111960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:20 devstack sudo[111960]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" returned: 0 in 0.710s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:20 devstack sudo[111965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5 Jun 23 12:58:20 devstack sudo[111965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:21 devstack sudo[111965]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" returned: 0 in 0.615s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-quobyte-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5" released by "delete_volume" :: held 1.380s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Created reservations ['9bcac037-5433-4419-acbe-6caa0e8cf706', '4281321f-d992-4382-8fbf-073cfa430499', '7cc315b4-7409-4edf-8d65-98c9a87eda96', 'c2daf7f1-3d8c-4452-a6c5-1b3b4747f980'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:21 devstack sudo[111968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:21 devstack sudo[111968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:22 devstack sudo[111968]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.664s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:22 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Deleted volume successfully. Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-e1522a50-0174-44a2-9e25-3415e194c9d5 tempest-CreateVolumesFromSnapshotTest-1741962502 None] Lock "cinder-eccd3c11-ca39-4617-9eba-ebcad6c2a5a5-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:22 devstack sudo[111971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:22 devstack sudo[111971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:22 devstack sudo[111971]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.711s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:58:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:58:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-59f9d6b3-3199-4806-ab08-1e051c240508 req-f44d8276-d0cc-4b46-a5b2-127e57e81c46 tempest-TestServerVolumeAttachmentScenario-457363964 None] Terminate volume connection completed successfully. Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-59f9d6b3-3199-4806-ab08-1e051c240508 req-f44d8276-d0cc-4b46-a5b2-127e57e81c46 tempest-TestServerVolumeAttachmentScenario-457363964 None] Deleting attachment bcb2489d-4af7-42fb-9af7-d599318e3d79. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Flow 'volume_create_manager' (27039544-8220-4fbd-a1a5-c6c11f17ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9702fe89-8767-4405-8a5e-36428c06544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9702fe89-8767-4405-8a5e-36428c06544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265f94c2-7d15-422e-94ac-f4989028871e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5792a4e24a01421689731c78b40abbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:58:25Z,use_quota=True,user_id='5d7e9a4585124096bf0e8f8f63c17aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61383fa4-a872-432f-b06d-d9b24c35f4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61383fa4-a872-432f-b06d-d9b24c35f4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325f3bd8-1306-439e-aa1d-bf141c534af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325f3bd8-1306-439e-aa1d-bf141c534af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265f94c2-7d15-422e-94ac-f4989028871e', 'volume_name': 'volume-265f94c2-7d15-422e-94ac-f4989028871e', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8962c183-6ac1-41ee-a2b6-aec38324cb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8962c183-6ac1-41ee-a2b6-aec38324cb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262dddea-7288-4f41-9d92-5b6c557d6182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:24 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Volume 265f94c2-7d15-422e-94ac-f4989028871e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265f94c2-7d15-422e-94ac-f4989028871e', 'volume_size': 1} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265f94c2-7d15-422e-94ac-f4989028871e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5792a4e24a01421689731c78b40abbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:58:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:58:25Z,use_quota=True,user_id='5d7e9a4585124096bf0e8f8f63c17aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Creating volume 265f94c2-7d15-422e-94ac-f4989028871e {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:58:24 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:58:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:24 devstack sudo[111981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e 1073741824 Jun 23 12:58:24 devstack sudo[111981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:25 devstack sudo[111981]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e 1073741824" returned: 0 in 0.785s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:25 devstack sudo[111986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e Jun 23 12:58:25 devstack sudo[111986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:26 devstack sudo[111986]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e" returned: 0 in 0.649s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:58:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262dddea-7288-4f41-9d92-5b6c557d6182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265f94c2-7d15-422e-94ac-f4989028871e', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b999020b-116e-4271-8c72-8559722835a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:26 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Volume volume-265f94c2-7d15-422e-94ac-f4989028871e (265f94c2-7d15-422e-94ac-f4989028871e): created successfully Jun 23 12:58:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b999020b-116e-4271-8c72-8559722835a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:26 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Flow 'volume_create_manager' (27039544-8220-4fbd-a1a5-c6c11f17ee53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:26 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-085ef420-5cc8-4981-a03c-55cb812e4db0 tempest-CinderUnicodeTest-1916315507 None] Created volume successfully. Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Flow 'volume_create_manager' (e477f29e-9cc1-4521-a426-78245569a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a81a910-2c3d-4869-9bf1-a301e5cd68bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a81a910-2c3d-4869-9bf1-a301e5cd68bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:58:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1703504124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50f4594-6ec6-41be-8e2d-8025c3a93a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5792a4e24a01421689731c78b40abbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:58:27Z,use_quota=True,user_id='5d7e9a4585124096bf0e8f8f63c17aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07095bc-0b80-4ef5-b9be-24c743321a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07095bc-0b80-4ef5-b9be-24c743321a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20f9d39-2988-424d-b74f-189f9ed70995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a20f9d39-2988-424d-b74f-189f9ed70995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a50f4594-6ec6-41be-8e2d-8025c3a93a81', 'volume_name': 'volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591b46a5-052f-4802-97ba-bd32685ed961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (591b46a5-052f-4802-97ba-bd32685ed961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db49a2ce-5719-466a-a20c-4ccdc9f29ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Volume a50f4594-6ec6-41be-8e2d-8025c3a93a81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81', 'volume_size': 1} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:58:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1703504124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a50f4594-6ec6-41be-8e2d-8025c3a93a81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5792a4e24a01421689731c78b40abbb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:58:27Z,use_quota=True,user_id='5d7e9a4585124096bf0e8f8f63c17aca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Creating volume a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:58:27 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:58:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:27 devstack sudo[111989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 1073741824 Jun 23 12:58:27 devstack sudo[111989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:28 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-b03f4b51-e521-4c93-873e-be08f7f614dc req-c162ca55-7457-4ac3-9227-d0d85e538b9e tempest-TestServerVolumeAttachmentScenario-457363964 None] Terminate volume connection completed successfully. Jun 23 12:58:28 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-b03f4b51-e521-4c93-873e-be08f7f614dc req-c162ca55-7457-4ac3-9227-d0d85e538b9e tempest-TestServerVolumeAttachmentScenario-457363964 None] Deleting attachment 422914d6-59be-4aaa-b9de-54c1c77ad222. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 12:58:28 devstack sudo[111989]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 1073741824" returned: 0 in 0.852s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:28 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 Jun 23 12:58:28 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:29 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81" returned: 0 in 0.636s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db49a2ce-5719-466a-a20c-4ccdc9f29ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa15d08-f3be-4c5f-9d5f-7ec7add16675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:58:29 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Volume volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 (a50f4594-6ec6-41be-8e2d-8025c3a93a81): created successfully Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa15d08-f3be-4c5f-9d5f-7ec7add16675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Flow 'volume_create_manager' (e477f29e-9cc1-4521-a426-78245569a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:58:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f7e9793f-2631-4921-9db8-6045779a6616 tempest-CinderUnicodeTest-1916315507 None] Created volume successfully. Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Creating offline snapshot a41aa411-c106-4892-950f-71d60eb236eb of volume a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ebcaef-69a6-4d19-adee-a80868a95671]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:29 devstack sudo[112034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 Jun 23 12:58:29 devstack sudo[112034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:30 devstack sudo[112034]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81" returned: 0 in 0.805s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:30 devstack sudo[112039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb 1G Jun 23 12:58:30 devstack sudo[112039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:31 devstack sudo[112039]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb 1G" returned: 0 in 0.993s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:31 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb Jun 23 12:58:31 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:32 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb" returned: 0 in 0.711s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:32 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb is being set with open permissions: ugo+rw Jun 23 12:58:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:32 devstack sudo[112092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb Jun 23 12:58:32 devstack sudo[112092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:32 devstack sudo[112092]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb" returned: 0 in 0.649s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:33 devstack sudo[112096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.info Jun 23 12:58:33 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:33 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.info" returned: 0 in 0.747s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:33 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.info is being set with open permissions: ugo+rw Jun 23 12:58:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:33 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.info Jun 23 12:58:33 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:34 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.info" returned: 0 in 0.640s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.642s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-763100f8-8d50-41ca-8491-bd6fff9ec404 tempest-CinderUnicodeTest-1916315507 None] Create snapshot completed successfully Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "cinder-a41aa411-c106-4892-950f-71d60eb236eb-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-a41aa411-c106-4892-950f-71d60eb236eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "cinder-quobyte-a50f4594-6ec6-41be-8e2d-8025c3a93a81" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-a50f4594-6ec6-41be-8e2d-8025c3a93a81" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "cinder-quobyte-a41aa411-c106-4892-950f-71d60eb236eb" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-a41aa411-c106-4892-950f-71d60eb236eb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Deleting offline snapshot a41aa411-c106-4892-950f-71d60eb236eb of volume a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] snapshot_file for this snap is: volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf8e074-e0be-4af6-bc2d-09fd6ff73cd6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:35 devstack sudo[112104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb Jun 23 12:58:35 devstack sudo[112104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:35 devstack sudo[112104]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb" returned: 0 in 0.747s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fdf2c0-6563-4eb7-b54e-7091a87db995]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:35 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 Jun 23 12:58:35 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:36 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81" returned: 0 in 0.784s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:36 devstack sudo[112115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb Jun 23 12:58:36 devstack sudo[112115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:37 devstack sudo[112115]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb" returned: 0 in 0.725s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:37 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb Jun 23 12:58:37 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:38 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81.a41aa411-c106-4892-950f-71d60eb236eb" returned: 0 in 0.721s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-a41aa411-c106-4892-950f-71d60eb236eb" released by "_delete_snapshot" :: held 3.095s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-a50f4594-6ec6-41be-8e2d-8025c3a93a81" released by "delete_snapshot" :: held 3.121s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Created reservations ['8e06c42b-aee9-43d4-9b0f-3d2ed9089adc', 'fdabc707-6047-4bdc-842c-2420ac1cb9d5', '70061c31-b05c-4110-9112-6be7f66dced9', '85cafd86-871e-4c6f-ba0c-b5a16cb5e3e4'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Delete snapshot completed successfully. Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d4f356db-fd30-4e3d-b37d-9eca42cb4992 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-a41aa411-c106-4892-950f-71d60eb236eb-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "cinder-d296ee35-e33a-4e17-a5c6-553b265f676b-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-d296ee35-e33a-4e17-a5c6-553b265f676b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "cinder-quobyte-d296ee35-e33a-4e17-a5c6-553b265f676b" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-quobyte-d296ee35-e33a-4e17-a5c6-553b265f676b" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e046784-903b-4797-a452-f5db2f9b5755]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:38 devstack sudo[112126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b Jun 23 12:58:38 devstack sudo[112126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "cinder-a50f4594-6ec6-41be-8e2d-8025c3a93a81-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-a50f4594-6ec6-41be-8e2d-8025c3a93a81-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "cinder-quobyte-a50f4594-6ec6-41be-8e2d-8025c3a93a81" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-a50f4594-6ec6-41be-8e2d-8025c3a93a81" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e05b32-7992-4e84-bea5-a6137220355b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:39 devstack sudo[112126]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b" returned: 0 in 0.791s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:39 devstack sudo[112132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b Jun 23 12:58:39 devstack sudo[112132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:39 devstack sudo[112131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 Jun 23 12:58:39 devstack sudo[112131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:40 devstack sudo[112132]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d296ee35-e33a-4e17-a5c6-553b265f676b" returned: 0 in 0.667s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-quobyte-d296ee35-e33a-4e17-a5c6-553b265f676b" released by "delete_volume" :: held 1.507s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=88,cinder:UPDATE=87,cinder:DELETE=10,cinder:INSERT=25 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:58:40 devstack sudo[112131]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81" returned: 0 in 0.779s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:40 devstack sudo[112140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81 Jun 23 12:58:40 devstack sudo[112140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Created reservations ['c8683fd8-e75f-4396-9c09-e983096a3f6a', '0f83271d-3048-403e-a8b9-d708c1d6aee2', '8d5944d9-ed6b-4f29-a7b8-2185eb5f0a03', 'e68b0f90-a7b5-4166-8108-26359bdbb351'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:40 devstack sudo[112142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:40 devstack sudo[112142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "cinder-57cbd84f-9d92-4f32-8146-73d8e31cbaa9-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-57cbd84f-9d92-4f32-8146-73d8e31cbaa9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:40 devstack sudo[112140]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-a50f4594-6ec6-41be-8e2d-8025c3a93a81" returned: 0 in 0.661s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-a50f4594-6ec6-41be-8e2d-8025c3a93a81" released by "delete_volume" :: held 1.513s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "cinder-quobyte-57cbd84f-9d92-4f32-8146-73d8e31cbaa9" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-quobyte-57cbd84f-9d92-4f32-8146-73d8e31cbaa9" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7eac0-7795-4605-8cb1-165dc4318532]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:40 devstack sudo[112142]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.675s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:40 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Deleted volume successfully. Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Created reservations ['8127e463-f148-4dae-85a7-84dd5dff5aaa', '892e5758-ace3-4007-8b95-3e4b68ec1217', '48587115-5565-42cb-834b-092a7934f465', '9c624089-3151-4fe9-ab91-ddc9ce56901b'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:40 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-506447ff-b990-431f-a5bd-ca7659a8c595 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-d296ee35-e33a-4e17-a5c6-553b265f676b-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:41 devstack sudo[112146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 Jun 23 12:58:41 devstack sudo[112146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:41 devstack sudo[112148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:41 devstack sudo[112148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "cinder-265f94c2-7d15-422e-94ac-f4989028871e-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-265f94c2-7d15-422e-94ac-f4989028871e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "cinder-quobyte-265f94c2-7d15-422e-94ac-f4989028871e" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-265f94c2-7d15-422e-94ac-f4989028871e" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff09b5bc-8176-4b63-a9a1-7a72316cea29]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:41 devstack sudo[112146]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9" returned: 0 in 0.763s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:41 devstack sudo[112155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9 Jun 23 12:58:41 devstack sudo[112155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:41 devstack sudo[112153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e Jun 23 12:58:41 devstack sudo[112153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:41 devstack sudo[112148]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.717s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:41 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Deleted volume successfully. Jun 23 12:58:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56894777-6c2b-4549-92f7-e346200f21ff tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-a50f4594-6ec6-41be-8e2d-8025c3a93a81-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:42 devstack sudo[112155]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57cbd84f-9d92-4f32-8146-73d8e31cbaa9" returned: 0 in 0.642s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:42 devstack sudo[112153]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e" returned: 0 in 0.734s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-quobyte-57cbd84f-9d92-4f32-8146-73d8e31cbaa9" released by "delete_volume" :: held 1.476s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:42 devstack sudo[112164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e Jun 23 12:58:42 devstack sudo[112164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Created reservations ['9a81e430-8f20-4d80-a182-ed4ce40b97f6', '73996e7b-27e5-4ab5-bdad-c087b48647fe', '5b7ad6a4-3425-41b6-b024-de59973b3d29', '51a948c1-6f34-49c0-be54-584d83583eb8'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:42 devstack sudo[112166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:42 devstack sudo[112166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:42 devstack sudo[112164]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-265f94c2-7d15-422e-94ac-f4989028871e" returned: 0 in 0.648s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-quobyte-265f94c2-7d15-422e-94ac-f4989028871e" released by "delete_volume" :: held 1.428s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Created reservations ['b93211ca-b093-405d-bbfe-3ceaa5aff6b4', 'ec24df61-612c-44d6-9c4d-391cb8c8a67b', '003fb037-1db9-4bc3-b43d-6e23c49b2937', '01f08842-585f-427b-b8b2-4bb171420e38'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 12:58:43 devstack sudo[112166]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.610s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:43 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Deleted volume successfully. Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-c488b7f2-a406-435b-971c-72b00dc2fe42 tempest-TestServerVolumeAttachmentScenario-457363964 None] Lock "cinder-57cbd84f-9d92-4f32-8146-73d8e31cbaa9-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:58:43 devstack sudo[112170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:58:43 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:58:43 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.669s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:58:43 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Deleted volume successfully. Jun 23 12:58:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-974f21e0-1369-46f5-8e41-9be962135cc9 tempest-CinderUnicodeTest-1916315507 None] Lock "cinder-265f94c2-7d15-422e-94ac-f4989028871e-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 12:58:53 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=91,cinder:UPDATE=126,cinder:INSERT=30,cinder:DELETE=9 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:58:53 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=30,cinder:SELECT=16,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Flow 'volume_create_manager' (54610ac7-3ff6-4915-9675-c48e6f870547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6069edf-7148-443c-86e5-11af0dc5c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6069edf-7148-443c-86e5-11af0dc5c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1327824043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce9bd35-59e5-4d63-91bf-97da8b395640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586389ae19c4831ba6b9d203db708f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:59:13Z,use_quota=True,user_id='be2c633101934267a5da13214609f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2e63ab-3592-4a8d-a328-4b5f4a85bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a2e63ab-3592-4a8d-a328-4b5f4a85bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7724a7c1-e34e-4957-a6dd-c2f91fb07f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7724a7c1-e34e-4957-a6dd-c2f91fb07f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce9bd35-59e5-4d63-91bf-97da8b395640', 'volume_name': 'volume-3ce9bd35-59e5-4d63-91bf-97da8b395640', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0ed34a-56b1-4289-9855-2c8853400bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0ed34a-56b1-4289-9855-2c8853400bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bacb53c-4929-45c4-ade6-2767c27d78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:59:13 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Volume 3ce9bd35-59e5-4d63-91bf-97da8b395640: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce9bd35-59e5-4d63-91bf-97da8b395640', 'volume_size': 1} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T10:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1327824043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce9bd35-59e5-4d63-91bf-97da8b395640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586389ae19c4831ba6b9d203db708f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T10:59:13Z,use_quota=True,user_id='be2c633101934267a5da13214609f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Creating volume 3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 12:59:13 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 12:59:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:59:13 devstack sudo[112218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 1073741824 Jun 23 12:59:13 devstack sudo[112218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:59:14 devstack sudo[112218]: pam_unix(sudo:session): session closed for user root Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 1073741824" returned: 0 in 0.896s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:59:14 devstack sudo[112227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 12:59:14 devstack sudo[112227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:59:14 devstack sudo[112227]: pam_unix(sudo:session): session closed for user root Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 0.648s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bacb53c-4929-45c4-ade6-2767c27d78bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce9bd35-59e5-4d63-91bf-97da8b395640', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af887ad4-dcc1-405c-83df-0bc0713a84b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 12:59:14 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Volume volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 (3ce9bd35-59e5-4d63-91bf-97da8b395640): created successfully Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af887ad4-dcc1-405c-83df-0bc0713a84b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 12:59:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Flow 'volume_create_manager' (54610ac7-3ff6-4915-9675-c48e6f870547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 12:59:14 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-cbb7498e-ac5d-4d85-a12b-17be81982a16 tempest-TestStampPattern-1841391536 None] Created volume successfully. Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:59:22 devstack sudo[112248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 12:59:22 devstack sudo[112248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:59:22 devstack sudo[112248]: pam_unix(sudo:session): session closed for user root Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.655s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 12:59:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 12:59:24 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:59:24 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 12:59:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-30c77041-689a-4a7f-8919-fd17033de142 req-1a9ee2be-fdf8-46dd-992e-558915530436 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 12:59:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-30c77041-689a-4a7f-8919-fd17033de142 req-1a9ee2be-fdf8-46dd-992e-558915530436 tempest-TestStampPattern-1841391536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 12:59:53 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad5e3a8e-1ae9-4f98-a3e8-2e49e497743b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 12:59:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-30c77041-689a-4a7f-8919-fd17033de142 req-1a9ee2be-fdf8-46dd-992e-558915530436 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 12:59:53 devstack sudo[112398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 12:59:53 devstack sudo[112398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 12:59:54 devstack sudo[112398]: pam_unix(sudo:session): session closed for user root Jun 23 12:59:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-30c77041-689a-4a7f-8919-fd17033de142 req-1a9ee2be-fdf8-46dd-992e-558915530436 tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 0.768s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 12:59:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-30c77041-689a-4a7f-8919-fd17033de142 req-1a9ee2be-fdf8-46dd-992e-558915530436 tempest-TestStampPattern-1841391536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.785s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 12:59:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-30c77041-689a-4a7f-8919-fd17033de142 req-1a9ee2be-fdf8-46dd-992e-558915530436 tempest-TestStampPattern-1841391536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-3ce9bd35-59e5-4d63-91bf-97da8b395640', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffbbd0b6-a9a1-432f-9304-44f467ab3066', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 12:59:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-30c77041-689a-4a7f-8919-fd17033de142 req-1a9ee2be-fdf8-46dd-992e-558915530436 tempest-TestStampPattern-1841391536 None] attachment_update completed successfully. Jun 23 13:00:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-9ad05d14-8afa-4fcc-974a-918ce22954e2 req-89483230-a1e8-4df4-a1b1-e5eb155357b6 tempest-TestStampPattern-1841391536 None] Terminate volume connection completed successfully. Jun 23 13:00:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-9ad05d14-8afa-4fcc-974a-918ce22954e2 req-89483230-a1e8-4df4-a1b1-e5eb155357b6 tempest-TestStampPattern-1841391536 None] Deleting attachment ffbbd0b6-a9a1-432f-9304-44f467ab3066. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:00:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:00:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:00:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Creating offline snapshot 3e10d004-17a3-488b-9389-32a1d803afbf of volume 3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:00:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d8b6c-4def-42d2-acda-e329fe6f213c]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:00:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:04 devstack sudo[112846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 13:00:04 devstack sudo[112846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:05 devstack sudo[112846]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 0.749s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:05 devstack sudo[112851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf 1G Jun 23 13:00:05 devstack sudo[112851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:06 devstack sudo[112851]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf 1G" returned: 0 in 0.786s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:06 devstack sudo[112856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf Jun 23 13:00:06 devstack sudo[112856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:06 devstack sudo[112856]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf" returned: 0 in 0.697s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:06 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf is being set with open permissions: ugo+rw Jun 23 13:00:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:06 devstack sudo[112861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf Jun 23 13:00:06 devstack sudo[112861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:07 devstack sudo[112861]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf" returned: 0 in 0.617s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:07 devstack sudo[112864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.info Jun 23 13:00:07 devstack sudo[112864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:08 devstack sudo[112864]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.info" returned: 0 in 0.644s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:08 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.info is being set with open permissions: ugo+rw Jun 23 13:00:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:08 devstack sudo[112868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.info Jun 23 13:00:08 devstack sudo[112868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:08 devstack sudo[112868]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.info" returned: 0 in 0.650s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.229s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:00:08 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-07916f03-b1c2-4dd5-a1c2-599c31c9338e tempest-TestStampPattern-1841391536 None] Create snapshot completed successfully Jun 23 13:00:17 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:00:18 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Flow 'volume_create_manager' (807ebd6e-5946-46ae-8e0b-e5022a6d9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f7fda0-dbb4-4cf2-bda4-60fc2d32f097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36f7fda0-dbb4-4cf2-bda4-60fc2d32f097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-355248138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f06450-5168-4331-8222-9ebca0f977a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9586389ae19c4831ba6b9d203db708f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3e10d004-17a3-488b-9389-32a1d803afbf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:00:19Z,use_quota=True,user_id='be2c633101934267a5da13214609f207',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f116473-4cea-4736-87de-feca4a2a9bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f116473-4cea-4736-87de-feca4a2a9bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694601d1-eb55-410e-8e9b-48b34adb0ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (694601d1-eb55-410e-8e9b-48b34adb0ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86f06450-5168-4331-8222-9ebca0f977a9', 'volume_name': 'volume-86f06450-5168-4331-8222-9ebca0f977a9', 'volume_size': 1, 'snapshot_id': '3e10d004-17a3-488b-9389-32a1d803afbf'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07646bf3-5b64-4ed8-a90a-dea29ba76950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07646bf3-5b64-4ed8-a90a-dea29ba76950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ef5999-050f-4481-9945-b9eda7c13ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:00:19 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Volume 86f06450-5168-4331-8222-9ebca0f977a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86f06450-5168-4331-8222-9ebca0f977a9', 'volume_size': 1, 'snapshot_id': '3e10d004-17a3-488b-9389-32a1d803afbf'} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-quobyte-3e10d004-17a3-488b-9389-32a1d803afbf-86f06450-5168-4331-8222-9ebca0f977a9" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3e10d004-17a3-488b-9389-32a1d803afbf-86f06450-5168-4331-8222-9ebca0f977a9" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Creating volume 86f06450-5168-4331-8222-9ebca0f977a9 from snapshot 3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-quobyte-86f06450-5168-4331-8222-9ebca0f977a9" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-86f06450-5168-4331-8222-9ebca0f977a9" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] snapshot: 3e10d004-17a3-488b-9389-32a1d803afbf, volume: 86f06450-5168-4331-8222-9ebca0f977a9, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c654f0c5-6cec-488d-b8b4-86cd6439f770]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:00:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:19 devstack sudo[112944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf Jun 23 13:00:19 devstack sudo[112944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:20 devstack sudo[112944]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf" returned: 0 in 0.781s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ce9bd35-59e5-4d63-91bf-97da8b395640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:00:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 13:00:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 13:00:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5424d995-b51b-450e-9737-08c228de2476]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:00:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:20 devstack sudo[112952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 13:00:20 devstack sudo[112952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:21 devstack sudo[112952]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 0.745s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:21 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 13:00:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:21 devstack sudo[112957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 Jun 23 13:00:21 devstack sudo[112957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:00:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:00:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:00:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:00:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:00:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:00:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:22 devstack sudo[112970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:00:22 devstack sudo[112970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:23 devstack sudo[112970]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.481s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:00:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:00:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:00:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:00:26 devstack sudo[112957]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9" returned: 0 in 4.807s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[93312486-6fb0-433a-b80c-97a4e450d9ea]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:00:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:26 devstack sudo[112973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 13:00:26 devstack sudo[112973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:27 devstack sudo[112973]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 1.000s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:00:27 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Converted 1024.00 MB image at 212.97 MB/s Jun 23 13:00:27 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 is being set with open permissions: ugo+rw Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:00:27 devstack sudo[112978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 Jun 23 13:00:27 devstack sudo[112978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:00:27 devstack sudo[112978]: pam_unix(sudo:session): session closed for user root Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9" returned: 0 in 0.754s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-86f06450-5168-4331-8222-9ebca0f977a9" released by "_copy_volume_from_snapshot" :: held 8.191s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3e10d004-17a3-488b-9389-32a1d803afbf-86f06450-5168-4331-8222-9ebca0f977a9" released by "_create_volume_from_snapshot" :: held 8.222s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.237s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ef5999-050f-4481-9945-b9eda7c13ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f06450-5168-4331-8222-9ebca0f977a9', 'volume_size': 1, 'snapshot_id': '3e10d004-17a3-488b-9389-32a1d803afbf'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a7da81-3917-441e-a733-e188442cb1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:00:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Volume volume-86f06450-5168-4331-8222-9ebca0f977a9 (86f06450-5168-4331-8222-9ebca0f977a9): created successfully Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a7da81-3917-441e-a733-e188442cb1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:00:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Flow 'volume_create_manager' (807ebd6e-5946-46ae-8e0b-e5022a6d9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:00:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-792350a7-6567-4ccd-8782-b82e1fa22306 tempest-TestStampPattern-1841391536 None] Created volume successfully. Jun 23 13:00:40 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:DELETE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:00:40 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:01:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-48198028-7ba6-4059-a361-47b055f5de7c req-4aba5ce0-05e7-40c2-877b-953ecca42c85 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:01:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-48198028-7ba6-4059-a361-47b055f5de7c req-4aba5ce0-05e7-40c2-877b-953ecca42c85 tempest-TestStampPattern-1841391536 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:01:16 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea2c5e3-2ba3-4f36-b466-e2860aab5963]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:01:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-48198028-7ba6-4059-a361-47b055f5de7c req-4aba5ce0-05e7-40c2-877b-953ecca42c85 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:16 devstack sudo[113160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 Jun 23 13:01:16 devstack sudo[113160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:17 devstack sudo[113160]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [req-48198028-7ba6-4059-a361-47b055f5de7c req-4aba5ce0-05e7-40c2-877b-953ecca42c85 tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9" returned: 0 in 0.819s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [req-48198028-7ba6-4059-a361-47b055f5de7c req-4aba5ce0-05e7-40c2-877b-953ecca42c85 tempest-TestStampPattern-1841391536 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.851s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:01:17 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-48198028-7ba6-4059-a361-47b055f5de7c req-4aba5ce0-05e7-40c2-877b-953ecca42c85 tempest-TestStampPattern-1841391536 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9', 'name': 'volume-86f06450-5168-4331-8222-9ebca0f977a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b721d2f-d428-4af8-9f19-d046f797777c', 'enforce_multipath': True} {{(pid=93659) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 13:01:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-48198028-7ba6-4059-a361-47b055f5de7c req-4aba5ce0-05e7-40c2-877b-953ecca42c85 tempest-TestStampPattern-1841391536 None] attachment_update completed successfully. Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:22 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:01:22 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:22 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.644s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:01:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:01:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [req-fb5f39cb-f216-4e09-8e58-0e91cc171856 req-78e690d8-c890-4b15-b56b-aab0f2d7d039 tempest-TestStampPattern-1841391536 None] Terminate volume connection completed successfully. Jun 23 13:01:24 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [req-fb5f39cb-f216-4e09-8e58-0e91cc171856 req-78e690d8-c890-4b15-b56b-aab0f2d7d039 tempest-TestStampPattern-1841391536 None] Deleting attachment 2b721d2f-d428-4af8-9f19-d046f797777c. {{(pid=93659) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 13:01:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-86f06450-5168-4331-8222-9ebca0f977a9-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:01:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Lock "cinder-86f06450-5168-4331-8222-9ebca0f977a9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:01:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-quobyte-86f06450-5168-4331-8222-9ebca0f977a9" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:01:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-86f06450-5168-4331-8222-9ebca0f977a9" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:01:33 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebca561d-5c16-42d0-9ed9-b695224e9d94]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:01:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:33 devstack sudo[113651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 Jun 23 13:01:33 devstack sudo[113651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:33 devstack sudo[113651]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9" returned: 0 in 0.777s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:33 devstack sudo[113656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9 Jun 23 13:01:33 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:01:34 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-86f06450-5168-4331-8222-9ebca0f977a9" returned: 0 in 0.634s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-86f06450-5168-4331-8222-9ebca0f977a9" released by "delete_volume" :: held 1.455s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Created reservations ['182f8f70-5596-412a-b3e1-341e57d856ed', '6aab0b0b-51b2-4704-b9a7-3a3639caa37b', 'c7f83f71-8e33-4ed2-b8ea-bed8f7436934', 'd3353bd1-bbc4-4b1f-b2bb-ed0164e0a61c'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:01:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:34 devstack sudo[113659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:01:34 devstack sudo[113659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:35 devstack sudo[113659]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.646s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:01:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Deleted volume successfully. Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-43bba0ec-c34a-4ad0-9b87-777470c912a9 tempest-TestStampPattern-1841391536 None] Lock "cinder-86f06450-5168-4331-8222-9ebca0f977a9-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-3e10d004-17a3-488b-9389-32a1d803afbf-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Lock "cinder-3e10d004-17a3-488b-9389-32a1d803afbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-quobyte-3ce9bd35-59e5-4d63-91bf-97da8b395640" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3ce9bd35-59e5-4d63-91bf-97da8b395640" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-quobyte-3e10d004-17a3-488b-9389-32a1d803afbf" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3e10d004-17a3-488b-9389-32a1d803afbf" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Deleting offline snapshot 3e10d004-17a3-488b-9389-32a1d803afbf of volume 3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] snapshot_file for this snap is: volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc55b9b9-1852-46cf-a137-416ae2e9a802]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:01:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:35 devstack sudo[113662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf Jun 23 13:01:35 devstack sudo[113662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:36 devstack sudo[113662]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf" returned: 0 in 0.717s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ce9bd35-59e5-4d63-91bf-97da8b395640(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:01:36 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f8d2bc-da54-44d7-8280-57f2433d98ae]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:01:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:36 devstack sudo[113667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 13:01:36 devstack sudo[113667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:37 devstack sudo[113667]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 0.827s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:37 devstack sudo[113672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf Jun 23 13:01:37 devstack sudo[113672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:37 devstack sudo[113672]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf" returned: 0 in 0.787s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:37 devstack sudo[113678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf Jun 23 13:01:37 devstack sudo[113678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:38 devstack sudo[113678]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640.3e10d004-17a3-488b-9389-32a1d803afbf" returned: 0 in 0.676s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3e10d004-17a3-488b-9389-32a1d803afbf" released by "_delete_snapshot" :: held 3.109s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:01:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3ce9bd35-59e5-4d63-91bf-97da8b395640" released by "delete_snapshot" :: held 3.131s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:01:38 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Created reservations ['f7270d69-7302-454d-8910-e9270ec3afde', '5423721c-466b-4dac-9469-7a87d6beb80b', 'b2cd9b6b-e840-43b4-98f0-add04d716cfc', 'ba37468a-4d17-46fc-a19e-0caab5d34cd9'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:01:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Delete snapshot completed successfully. Jun 23 13:01:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-eb116a9e-01ea-4c1d-b91d-970c54ab825e tempest-TestStampPattern-1841391536 None] Lock "cinder-3e10d004-17a3-488b-9389-32a1d803afbf-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-3ce9bd35-59e5-4d63-91bf-97da8b395640-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Lock "cinder-3ce9bd35-59e5-4d63-91bf-97da8b395640-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Acquiring lock "cinder-quobyte-3ce9bd35-59e5-4d63-91bf-97da8b395640" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3ce9bd35-59e5-4d63-91bf-97da8b395640" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[df737ae5-f612-4281-be5c-3afc03d8cfa7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:47 devstack sudo[113742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 13:01:47 devstack sudo[113742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:47 devstack sudo[113742]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 0.719s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:47 devstack sudo[113748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640 Jun 23 13:01:47 devstack sudo[113748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:48 devstack sudo[113748]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-3ce9bd35-59e5-4d63-91bf-97da8b395640" returned: 0 in 0.613s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Lock "cinder-quobyte-3ce9bd35-59e5-4d63-91bf-97da8b395640" released by "delete_volume" :: held 1.387s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Created reservations ['f67239b2-1f5d-4bda-8839-87f8e51ad058', 'c4ad24ab-f6f2-4725-8b5b-5c99f4cafd1f', 'c6c6dd92-9459-4ec8-8f05-e0b167e5525e', '85858482-96f0-401b-86d8-71719eb042c1'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:01:48 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:01:48 devstack sudo[113751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:01:48 devstack sudo[113751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:01:49 devstack sudo[113751]: pam_unix(sudo:session): session closed for user root Jun 23 13:01:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.620s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:01:49 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:01:49 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Deleted volume successfully. Jun 23 13:01:49 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4e471b90-b468-461d-ac34-1728a72f07ec tempest-TestStampPattern-1841391536 None] Lock "cinder-3ce9bd35-59e5-4d63-91bf-97da8b395640-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:01:58 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=22,cinder:UPDATE=28,cinder:INSERT=7 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:01:59 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (e7c01006-e0b4-486d-9603-d91114877339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d44332-3bd6-4b9d-82f8-a9316d836745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d44332-3bd6-4b9d-82f8-a9316d836745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470531059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66869d3e-41ab-4b7d-974c-6aa68211ca2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:00Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdb9264-c8b6-420a-8dd2-d1cc300ad6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cdb9264-c8b6-420a-8dd2-d1cc300ad6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409ab043-6bd1-49cb-bdde-05b3c60638f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409ab043-6bd1-49cb-bdde-05b3c60638f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66869d3e-41ab-4b7d-974c-6aa68211ca2c', 'volume_name': 'volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0527800a-3545-46af-8288-58129da47627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0527800a-3545-46af-8288-58129da47627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acc22a2-746b-420c-a060-5ce08a14d1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume 66869d3e-41ab-4b7d-974c-6aa68211ca2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c', 'volume_size': 1} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1470531059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66869d3e-41ab-4b7d-974c-6aa68211ca2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:00Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Creating volume 66869d3e-41ab-4b7d-974c-6aa68211ca2c {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:02:00 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:02:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:00 devstack sudo[113760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c 1073741824 Jun 23 13:02:00 devstack sudo[113760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:01 devstack sudo[113760]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c 1073741824" returned: 0 in 0.766s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:01 devstack sudo[113766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c Jun 23 13:02:01 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:01 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c" returned: 0 in 0.620s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7acc22a2-746b-420c-a060-5ce08a14d1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71783ab6-0ca4-42d0-bfc8-88f4bba73bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c (66869d3e-41ab-4b7d-974c-6aa68211ca2c): created successfully Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71783ab6-0ca4-42d0-bfc8-88f4bba73bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (e7c01006-e0b4-486d-9603-d91114877339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7b8e3223-4e11-4d14-bb29-5b7f573f2616 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created volume successfully. Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (04979e67-2d74-4dea-beb4-8a3d6eb83b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfb39d8-8cf1-4476-8cb6-b6a2e7c66ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddfb39d8-8cf1-4476-8cb6-b6a2e7c66ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847836468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b0b340-abcb-4586-b146-3bf7e2b496d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:03Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec15d92-e9a8-4173-8347-127f482c8891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec15d92-e9a8-4173-8347-127f482c8891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a2faf3-76ec-40d8-8e4a-56471cc4bf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a2faf3-76ec-40d8-8e4a-56471cc4bf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b0b340-abcb-4586-b146-3bf7e2b496d8', 'volume_name': 'volume-57b0b340-abcb-4586-b146-3bf7e2b496d8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955624cc-47a6-42f9-83d3-342f94c9bd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955624cc-47a6-42f9-83d3-342f94c9bd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f50a8b-4393-4b9b-b75d-c34ba00f8d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:02 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume 57b0b340-abcb-4586-b146-3bf7e2b496d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b0b340-abcb-4586-b146-3bf7e2b496d8', 'volume_size': 1} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-847836468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b0b340-abcb-4586-b146-3bf7e2b496d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:03Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Creating volume 57b0b340-abcb-4586-b146-3bf7e2b496d8 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:02:02 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:02:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:02 devstack sudo[113769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 1073741824 Jun 23 13:02:02 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (85f8cafd-b1c4-4df4-93de-25e212229b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90041fd4-bd23-434a-9c17-69f91d4db946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90041fd4-bd23-434a-9c17-69f91d4db946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194086039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965fd8ad-d76c-460f-bece-bc833329a819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:03Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d113b9-c4c3-4bf7-8efa-faca850f7710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d113b9-c4c3-4bf7-8efa-faca850f7710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e41344-901b-4ba3-8093-0484484a8adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28e41344-901b-4ba3-8093-0484484a8adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '965fd8ad-d76c-460f-bece-bc833329a819', 'volume_name': 'volume-965fd8ad-d76c-460f-bece-bc833329a819', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ae411-e3da-4549-bb39-091d816fccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3ae411-e3da-4549-bb39-091d816fccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b500c328-fa6d-4696-b352-f743acdf5ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume 965fd8ad-d76c-460f-bece-bc833329a819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-965fd8ad-d76c-460f-bece-bc833329a819', 'volume_size': 1} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (213af9e4-4879-47b8-93fd-1cf7d9a2cf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6861c67-d644-4ac6-937c-400758eada4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6861c67-d644-4ac6-937c-400758eada4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072987933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2743d9-6586-4bfc-8557-604777e8da74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:03Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26004916-96e8-4ffa-ba3e-ab80ce6c61f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26004916-96e8-4ffa-ba3e-ab80ce6c61f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595f0a5b-8702-468d-a5ff-8359df9dd61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595f0a5b-8702-468d-a5ff-8359df9dd61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2743d9-6586-4bfc-8557-604777e8da74', 'volume_name': 'volume-5e2743d9-6586-4bfc-8557-604777e8da74', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978109cb-1ae7-45b2-b3fc-b92505a63e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978109cb-1ae7-45b2-b3fc-b92505a63e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801c4295-4b44-45a3-b28f-df38d7721d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume 5e2743d9-6586-4bfc-8557-604777e8da74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2743d9-6586-4bfc-8557-604777e8da74', 'volume_size': 1} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:03 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 1073741824" returned: 0 in 0.989s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:02:03 devstack sudo[113775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 Jun 23 13:02:03 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (ed6a9957-df00-4925-a2ff-5abd5f802928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308be314-27b6-4b1a-9585-a9ce7bcc4a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308be314-27b6-4b1a-9585-a9ce7bcc4a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850074842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b9e7c-09b8-4bdb-b3d0-57994675fa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:04Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7440c3a6-d2cb-4613-8cd2-484691c1dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7440c3a6-d2cb-4613-8cd2-484691c1dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19888c34-caf2-40a2-aff1-521d0fcd087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19888c34-caf2-40a2-aff1-521d0fcd087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1b9e7c-09b8-4bdb-b3d0-57994675fa89', 'volume_name': 'volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e5a161-8915-4d3d-a260-af390d53573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e5a161-8915-4d3d-a260-af390d53573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee27a01f-a0e3-4a8e-9032-804fa662153a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:03 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume 7a1b9e7c-09b8-4bdb-b3d0-57994675fa89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89', 'volume_size': 1} Jun 23 13:02:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (f071e91e-3d95-4c08-980e-fc19e8431a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433c92e9-2876-4e79-8d84-5c148d9de1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (433c92e9-2876-4e79-8d84-5c148d9de1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830854991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a58dfa-0cce-43ad-b7ea-1eafd3e82330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:04Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852ad5ca-06ac-4c60-bfae-184ef002e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852ad5ca-06ac-4c60-bfae-184ef002e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7460b396-01ad-4abc-bef3-03143084a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7460b396-01ad-4abc-bef3-03143084a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50a58dfa-0cce-43ad-b7ea-1eafd3e82330', 'volume_name': 'volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff42c0f-5306-461a-9a44-ebd129889dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff42c0f-5306-461a-9a44-ebd129889dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b5603c-0e53-49d8-b0e6-68e8f9ecf08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:04 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume 50a58dfa-0cce-43ad-b7ea-1eafd3e82330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330', 'volume_size': 1} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:04 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8" returned: 0 in 0.725s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.394s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-194086039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=965fd8ad-d76c-460f-bece-bc833329a819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:03Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Creating volume 965fd8ad-d76c-460f-bece-bc833329a819 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:02:04 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f50a8b-4393-4b9b-b75d-c34ba00f8d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b0b340-abcb-4586-b146-3bf7e2b496d8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:04 devstack sudo[113778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 1073741824 Jun 23 13:02:04 devstack sudo[113778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db8a081-dcca-4b53-bd71-0b1dcfdbb9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:04 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 (57b0b340-abcb-4586-b146-3bf7e2b496d8): created successfully Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db8a081-dcca-4b53-bd71-0b1dcfdbb9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (04979e67-2d74-4dea-beb4-8a3d6eb83b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:04 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e4a02b4a-7d60-405e-aa3d-01d234279e85 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created volume successfully. Jun 23 13:02:05 devstack sudo[113778]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 1073741824" returned: 0 in 0.941s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:05 devstack sudo[113784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 Jun 23 13:02:05 devstack sudo[113784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:06 devstack sudo[113784]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819" returned: 0 in 0.641s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.607s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072987933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2743d9-6586-4bfc-8557-604777e8da74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:03Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Creating volume 5e2743d9-6586-4bfc-8557-604777e8da74 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:02:06 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b500c328-fa6d-4696-b352-f743acdf5ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-965fd8ad-d76c-460f-bece-bc833329a819', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:06 devstack sudo[113787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 1073741824 Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af49cf63-ec29-4a13-af2d-d17958434e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:06 devstack sudo[113787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:06 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume volume-965fd8ad-d76c-460f-bece-bc833329a819 (965fd8ad-d76c-460f-bece-bc833329a819): created successfully Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af49cf63-ec29-4a13-af2d-d17958434e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (85f8cafd-b1c4-4df4-93de-25e212229b4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:06 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2912cc9a-887e-4f83-b326-12ce88112d42 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created volume successfully. Jun 23 13:02:07 devstack sudo[113787]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 1073741824" returned: 0 in 0.815s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:07 devstack sudo[113793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 Jun 23 13:02:07 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:07 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74" returned: 0 in 0.674s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.791s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-850074842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1b9e7c-09b8-4bdb-b3d0-57994675fa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:04Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Creating volume 7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:02:07 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:07 devstack sudo[113797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 1073741824 Jun 23 13:02:07 devstack sudo[113797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801c4295-4b44-45a3-b28f-df38d7721d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2743d9-6586-4bfc-8557-604777e8da74', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e52b2b-5314-42aa-8077-b2c0f9222675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:07 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume volume-5e2743d9-6586-4bfc-8557-604777e8da74 (5e2743d9-6586-4bfc-8557-604777e8da74): created successfully Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e52b2b-5314-42aa-8077-b2c0f9222675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (213af9e4-4879-47b8-93fd-1cf7d9a2cf6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b1f402df-9c0c-48aa-8c58-ac53d97049c7 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created volume successfully. Jun 23 13:02:08 devstack sudo[113797]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 1073741824" returned: 0 in 0.868s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:08 devstack sudo[113803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 Jun 23 13:02:08 devstack sudo[113803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:09 devstack sudo[113803]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89" returned: 0 in 0.632s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.019s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-830854991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50a58dfa-0cce-43ad-b7ea-1eafd3e82330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1daab1401547a1b935ccd6c3695951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:04Z,use_quota=True,user_id='475dee83e3a841c09a0dc9a760f3d09b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Creating volume 50a58dfa-0cce-43ad-b7ea-1eafd3e82330 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:02:09 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee27a01f-a0e3-4a8e-9032-804fa662153a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:09 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 1073741824 Jun 23 13:02:09 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834b9104-4aba-4379-aaab-5f199eda09f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:09 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 (7a1b9e7c-09b8-4bdb-b3d0-57994675fa89): created successfully Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834b9104-4aba-4379-aaab-5f199eda09f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (ed6a9957-df00-4925-a2ff-5abd5f802928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d367b42b-14d9-4275-ab7a-94aa9bc86b18 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created volume successfully. Jun 23 13:02:10 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 1073741824" returned: 0 in 0.786s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:10 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 Jun 23 13:02:10 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:10 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330" returned: 0 in 0.611s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b5603c-0e53-49d8-b0e6-68e8f9ecf08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be83c6e-eeaf-479a-8018-abfbe37994ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:10 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Volume volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 (50a58dfa-0cce-43ad-b7ea-1eafd3e82330): created successfully Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be83c6e-eeaf-479a-8018-abfbe37994ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Flow 'volume_create_manager' (f071e91e-3d95-4c08-980e-fc19e8431a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0cd0941b-82cb-4790-80a3-28460153afe3 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created volume successfully. Jun 23 13:02:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-50a58dfa-0cce-43ad-b7ea-1eafd3e82330-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-50a58dfa-0cce-43ad-b7ea-1eafd3e82330-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-quobyte-50a58dfa-0cce-43ad-b7ea-1eafd3e82330" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-50a58dfa-0cce-43ad-b7ea-1eafd3e82330" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ece17e-c0bc-4280-95a9-9e6182df8e91]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:12 devstack sudo[113814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 Jun 23 13:02:12 devstack sudo[113814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:12 devstack sudo[113814]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330" returned: 0 in 0.762s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:12 devstack sudo[113819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330 Jun 23 13:02:12 devstack sudo[113819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:13 devstack sudo[113819]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-50a58dfa-0cce-43ad-b7ea-1eafd3e82330" returned: 0 in 0.632s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-50a58dfa-0cce-43ad-b7ea-1eafd3e82330" released by "delete_volume" :: held 1.434s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created reservations ['1bebe2e5-9d2a-4dc6-ae60-5e7629c508bc', '0183b22e-208c-409e-a6c2-b32f5816a128', 'ebd3dc4e-f92c-4bd8-bf42-6663b8da1858', '90ce0c7f-fec9-496a-8118-ab8455ab7669'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:13 devstack sudo[113822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:13 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-quobyte-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab52df7-f918-43a6-b93f-996b5410b8af]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:14 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.746s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:14 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Deleted volume successfully. Jun 23 13:02:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-37ff8657-3615-4f52-afe6-e1b4dee3632c tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-50a58dfa-0cce-43ad-b7ea-1eafd3e82330-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:14 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 Jun 23 13:02:14 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:15 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89" returned: 0 in 0.764s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:15 devstack sudo[113866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89 Jun 23 13:02:15 devstack sudo[113866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:15 devstack sudo[113866]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89" returned: 0 in 0.680s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89" released by "delete_volume" :: held 1.484s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created reservations ['8ec559e8-bc26-4ecc-973e-9803c2ceef33', '4e9b4f7f-9aa9-426f-bd71-b4d5c50ef420', 'f5cf109d-cdea-4f59-976e-b0a493b62a62', '6b12aa0c-d748-422d-a0ef-f5d12f6e4886'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:15 devstack sudo[113869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:15 devstack sudo[113869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-5e2743d9-6586-4bfc-8557-604777e8da74-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-5e2743d9-6586-4bfc-8557-604777e8da74-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-quobyte-5e2743d9-6586-4bfc-8557-604777e8da74" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-5e2743d9-6586-4bfc-8557-604777e8da74" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9984f9-fb49-4a72-abe7-98b8e9f231f2]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:16 devstack sudo[113869]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.681s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:16 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Deleted volume successfully. Jun 23 13:02:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d94adce-ff97-4fb1-96d4-1d537873c24e tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-7a1b9e7c-09b8-4bdb-b3d0-57994675fa89-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:16 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 Jun 23 13:02:16 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:17 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74" returned: 0 in 0.791s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:17 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74 Jun 23 13:02:17 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:17 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-5e2743d9-6586-4bfc-8557-604777e8da74" returned: 0 in 0.708s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-5e2743d9-6586-4bfc-8557-604777e8da74" released by "delete_volume" :: held 1.551s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created reservations ['1915bd91-e745-4896-aad2-84c551379cbe', '1c610bc4-7c3a-4723-ad92-1e37d32b40d6', 'ad2137e8-7032-4899-94ab-120e6bd190e1', '750bdb0b-9e19-4016-ac56-d77ec02707e7'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:18 devstack sudo[113881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:18 devstack sudo[113881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-965fd8ad-d76c-460f-bece-bc833329a819-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-965fd8ad-d76c-460f-bece-bc833329a819-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-quobyte-965fd8ad-d76c-460f-bece-bc833329a819" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-965fd8ad-d76c-460f-bece-bc833329a819" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f0033-7cfd-480b-90ed-a246b2b6859d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:18 devstack sudo[113881]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.683s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Deleted volume successfully. Jun 23 13:02:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-47940d47-524b-4107-8697-8cc3b330f8fe tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-5e2743d9-6586-4bfc-8557-604777e8da74-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:18 devstack sudo[113884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 Jun 23 13:02:18 devstack sudo[113884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:19 devstack sudo[113884]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819" returned: 0 in 0.766s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:19 devstack sudo[113889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819 Jun 23 13:02:19 devstack sudo[113889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:20 devstack sudo[113889]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-965fd8ad-d76c-460f-bece-bc833329a819" returned: 0 in 0.704s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-965fd8ad-d76c-460f-bece-bc833329a819" released by "delete_volume" :: held 1.515s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created reservations ['ae0a230c-1864-4c38-959b-58dea40aa91f', '913eddf6-61a1-4a3c-8108-29fe3dfa10ba', '00c47379-3096-4025-bc38-b3c20e43eaa5', '3e3eb1ca-faf2-4161-ada7-f5d68253cfa6'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:20 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:20 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-57b0b340-abcb-4586-b146-3bf7e2b496d8-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-57b0b340-abcb-4586-b146-3bf7e2b496d8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-quobyte-57b0b340-abcb-4586-b146-3bf7e2b496d8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-57b0b340-abcb-4586-b146-3bf7e2b496d8" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b810c93-9dac-4a71-a0cb-bb89a8237873]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:21 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.744s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:21 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:21 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Deleted volume successfully. Jun 23 13:02:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a0de225f-e0ab-4c83-bc12-f5908f01aa70 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-965fd8ad-d76c-460f-bece-bc833329a819-delete_volume" released by "delete_volume" :: held 2.491s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:21 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 Jun 23 13:02:21 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:21 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8" returned: 0 in 0.835s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:21 devstack sudo[113900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8 Jun 23 13:02:21 devstack sudo[113900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:22 devstack sudo[113902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:22 devstack sudo[113902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:22 devstack sudo[113900]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-57b0b340-abcb-4586-b146-3bf7e2b496d8" returned: 0 in 0.680s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-57b0b340-abcb-4586-b146-3bf7e2b496d8" released by "delete_volume" :: held 1.568s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created reservations ['e454525e-1c20-458d-9825-abf646b8f18d', '6736dff3-00df-4753-973d-0fb9cd1fb27d', '67b0fd95-49ae-47cc-a8f8-6aed517532d9', '2f49de47-fcc0-4b2c-b633-37a44d48e0a3'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:22 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:22 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:22 devstack sudo[113902]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.690s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:02:22 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-66869d3e-41ab-4b7d-974c-6aa68211ca2c-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-66869d3e-41ab-4b7d-974c-6aa68211ca2c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "cinder-quobyte-66869d3e-41ab-4b7d-974c-6aa68211ca2c" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-66869d3e-41ab-4b7d-974c-6aa68211ca2c" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c8a432-b4b6-4e9b-93d9-ae1236c98c15]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:23 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:23 devstack sudo[113909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.696s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:23 devstack sudo[113909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:23 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Deleted volume successfully. Jun 23 13:02:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-be2967e1-a34f-4cb7-a78e-8bae46878296 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-57b0b340-abcb-4586-b146-3bf7e2b496d8-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:24 devstack sudo[113909]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c" returned: 0 in 0.768s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:24 devstack sudo[113914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c Jun 23 13:02:24 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:24 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-66869d3e-41ab-4b7d-974c-6aa68211ca2c" returned: 0 in 0.640s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-quobyte-66869d3e-41ab-4b7d-974c-6aa68211ca2c" released by "delete_volume" :: held 1.452s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Created reservations ['4dd207a8-fbf4-4c9e-a842-e226f055b30b', '762daf8d-ae67-40fb-9bf4-d6dc66180f41', '6d45451c-e2cc-48e6-8966-3562041ced7e', 'ab3acb79-7429-463d-b3a1-21d215d8e215'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:24 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:24 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:25 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.716s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:25 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:25 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Deleted volume successfully. Jun 23 13:02:25 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f8a6c52a-7a53-4cf3-a4fb-42a8bf968199 tempest-CreateVolumesFromSourceVolumeTest-556331631 None] Lock "cinder-66869d3e-41ab-4b7d-974c-6aa68211ca2c-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Flow 'volume_create_manager' (7fffb337-b62f-4d30-bdab-79f3f677e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afab572d-1e37-467d-aeb6-406b20e8ae7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afab572d-1e37-467d-aeb6-406b20e8ae7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a08eae-2a64-490e-ab34-1282ab370646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6182f0d5d3c4714b9218a666298d9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:30Z,use_quota=True,user_id='a3ff59911cc14ad78d5b8ae17d3cd002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8c459a-36ee-4671-b9e1-4b9b8ebbe6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8c459a-36ee-4671-b9e1-4b9b8ebbe6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33bf5e1-b176-4caa-a3a5-ff24c6daaebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33bf5e1-b176-4caa-a3a5-ff24c6daaebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2a08eae-2a64-490e-ab34-1282ab370646', 'volume_name': 'volume-d2a08eae-2a64-490e-ab34-1282ab370646', 'volume_size': 1, 'image_id': '1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '029e7a4d904cdd8a776efd6fd065cd6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6182f0d5d3c4714b9218a666298d9fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00e7c1c04cf733194e7a39064efef1f425dacceb83674593c44af3f3a4e0fd5758b25bd9b6d1a95763552147ca665fbf016b7fa06253869ab345062729343ce2', 'id': '1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'created_at': datetime.datetime(2026, 6, 23, 11, 2, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca/file', 'properties': {}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f1d521-c6ae-4709-8884-b2e4adc95043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f1d521-c6ae-4709-8884-b2e4adc95043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08191fc2-0d3c-4e54-ae65-8b5277d014f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:30 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Volume d2a08eae-2a64-490e-ab34-1282ab370646: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2a08eae-2a64-490e-ab34-1282ab370646', 'volume_size': 1, 'image_id': '1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '029e7a4d904cdd8a776efd6fd065cd6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6182f0d5d3c4714b9218a666298d9fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00e7c1c04cf733194e7a39064efef1f425dacceb83674593c44af3f3a4e0fd5758b25bd9b6d1a95763552147ca665fbf016b7fa06253869ab345062729343ce2', 'id': '1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'created_at': datetime.datetime(2026, 6, 23, 11, 2, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca/file', 'properties': {}}, 'image_service': } Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Trying to clone d2a08eae-2a64-490e-ab34-1282ab370646 from image 1144fc0c-ccd5-4cc1-b032-ea97d6212bca at location (None, [{'url': 'file:///opt/stack/data/glance/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 13:02:30 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Image download 0.00 MB at 0.00 MB/s Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7930b41e-5085-4caa-a1d4-9a1dc7a7f2e4]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:31 devstack sudo[113927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD Jun 23 13:02:31 devstack sudo[113927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:31 devstack sudo[113927]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:31 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD Jun 23 13:02:31 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:32 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD" returned: 1 in 0.719s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:02:32 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Temporary image 1144fc0c-ccd5-4cc1-b032-ea97d6212bca is fetched for user a3ff59911cc14ad78d5b8ae17d3cd002. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 13:02:32 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daccb42-4881-40dc-b695-0289d5b0cdba]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:32 devstack sudo[113936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD Jun 23 13:02:32 devstack sudo[113936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:33 devstack sudo[113936]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:33 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD Jun 23 13:02:33 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:34 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD" returned: 1 in 0.767s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a08eae-2a64-490e-ab34-1282ab370646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6182f0d5d3c4714b9218a666298d9fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:02:30Z,use_quota=True,user_id='a3ff59911cc14ad78d5b8ae17d3cd002',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Creating volume d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:02:34 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:34 devstack sudo[113945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 1073741824 Jun 23 13:02:34 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:34 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 1073741824" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:35 devstack sudo[113952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 Jun 23 13:02:35 devstack sudo[113952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:35 devstack sudo[113952]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646" returned: 0 in 0.697s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:02:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:35 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Attempting download of 1144fc0c-ccd5-4cc1-b032-ea97d6212bca ((None, [{'url': 'file:///opt/stack/data/glance/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'metadata': {}}])) to volume d2a08eae-2a64-490e-ab34-1282ab370646. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 13:02:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[60378c58-65cf-47e9-9502-b36cb5699748]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_y3bo1bov {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:35 devstack sudo[113955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_y3bo1bov Jun 23 13:02:35 devstack sudo[113955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:36 devstack sudo[113955]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_y3bo1bov" returned: 0 in 0.788s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_y3bo1bov {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:36 devstack sudo[113959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_y3bo1bov Jun 23 13:02:36 devstack sudo[113959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:37 devstack sudo[113959]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_y3bo1bov" returned: 1 in 0.761s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_y3bo1bov' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:02:37 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[00726877-c148-44c7-9a32-7e9a4149e209]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:37 devstack sudo[113963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD Jun 23 13:02:37 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:38 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:38 devstack sudo[113968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD Jun 23 13:02:38 devstack sudo[113968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:38 devstack sudo[113968]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD" returned: 1 in 0.846s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:02:38 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] 1144fc0c-ccd5-4cc1-b032-ea97d6212bca was raw, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 13:02:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:38 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 Jun 23 13:02:38 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:39 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646" returned: 0 in 0.817s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:39 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1144fc0c-ccd5-4cc1-b032-ea97d6212bca_3a69fn5ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:02:39 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 13:02:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:39 devstack sudo[113979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 1G Jun 23 13:02:39 devstack sudo[113979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:40 devstack sudo[113979]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 1G" returned: 0 in 0.684s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:40 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[029bb92e-bef9-45ca-9a25-7883bf0d5d5b]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:40 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 Jun 23 13:02:40 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:41 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646" returned: 0 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:41 devstack sudo[113990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 Jun 23 13:02:41 devstack sudo[113990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:41 devstack sudo[113990]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646" returned: 1 in 0.740s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Downloaded image 1144fc0c-ccd5-4cc1-b032-ea97d6212bca ((None, [{'url': 'file:///opt/stack/data/glance/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'metadata': {}}])) to volume d2a08eae-2a64-490e-ab34-1282ab370646 successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Temporary image 1144fc0c-ccd5-4cc1-b032-ea97d6212bca for user a3ff59911cc14ad78d5b8ae17d3cd002 is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Marking volume d2a08eae-2a64-490e-ab34-1282ab370646 as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Copying metadata from image 1144fc0c-ccd5-4cc1-b032-ea97d6212bca to d2a08eae-2a64-490e-ab34-1282ab370646. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 13:02:41 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Creating volume glance metadata for volume d2a08eae-2a64-490e-ab34-1282ab370646 backed by image 1144fc0c-ccd5-4cc1-b032-ea97d6212bca with: {'image_id': '1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '029e7a4d904cdd8a776efd6fd065cd6d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 13:02:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08191fc2-0d3c-4e54-ae65-8b5277d014f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a08eae-2a64-490e-ab34-1282ab370646', 'volume_size': 1, 'image_id': '1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '029e7a4d904cdd8a776efd6fd065cd6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e6182f0d5d3c4714b9218a666298d9fa', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '00e7c1c04cf733194e7a39064efef1f425dacceb83674593c44af3f3a4e0fd5758b25bd9b6d1a95763552147ca665fbf016b7fa06253869ab345062729343ce2', 'id': '1144fc0c-ccd5-4cc1-b032-ea97d6212bca', 'created_at': datetime.datetime(2026, 6, 23, 11, 2, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 2, 29, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1144fc0c-ccd5-4cc1-b032-ea97d6212bca/file', 'properties': {}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5250af3d-005a-4ebf-8af7-12cbd9f4cdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:02:42 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Volume volume-d2a08eae-2a64-490e-ab34-1282ab370646 (d2a08eae-2a64-490e-ab34-1282ab370646): created successfully Jun 23 13:02:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5250af3d-005a-4ebf-8af7-12cbd9f4cdb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:02:42 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Flow 'volume_create_manager' (7fffb337-b62f-4d30-bdab-79f3f677e418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:02:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f0023d73-7d14-433a-a501-48ced6beb264 tempest-VolumeImageDependencyTests-1842885448 None] Created volume successfully. Jun 23 13:02:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Acquiring lock "cinder-d2a08eae-2a64-490e-ab34-1282ab370646-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Lock "cinder-d2a08eae-2a64-490e-ab34-1282ab370646-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Acquiring lock "cinder-quobyte-d2a08eae-2a64-490e-ab34-1282ab370646" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:02:43 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Lock "cinder-quobyte-d2a08eae-2a64-490e-ab34-1282ab370646" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:02:43 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3290680-6c36-4dfd-9a39-550ccc57ac66]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:02:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:43 devstack sudo[113997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 Jun 23 13:02:43 devstack sudo[113997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:44 devstack sudo[113997]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646" returned: 0 in 0.774s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:44 devstack sudo[114001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 Jun 23 13:02:44 devstack sudo[114001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:44 devstack sudo[114001]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646" returned: 1 in 0.804s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:02:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:45 devstack sudo[114006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646 Jun 23 13:02:45 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:45 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d2a08eae-2a64-490e-ab34-1282ab370646" returned: 0 in 0.651s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Lock "cinder-quobyte-d2a08eae-2a64-490e-ab34-1282ab370646" released by "delete_volume" :: held 2.300s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Created reservations ['56a66a4e-63cd-417a-817c-7c63428404b9', '5a9c8e94-128b-4705-9050-8f25f3d4393c', '3abf4aec-70e9-4b97-97c0-17ffa08f5a5f', '380f0c9b-6692-4b74-83c3-3ca3e45b8142'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:02:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:02:45 devstack sudo[114009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:02:45 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:02:46 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root Jun 23 13:02:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.633s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:02:46 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:02:46 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Deleted volume successfully. Jun 23 13:02:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-6ab120bf-c765-4977-b79d-d8b61f801b26 tempest-VolumeImageDependencyTests-1842885448 None] Lock "cinder-d2a08eae-2a64-490e-ab34-1282ab370646-delete_volume" released by "delete_volume" :: held 3.154s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:02:55 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=52,cinder:UPDATE=79,cinder:INSERT=27,cinder:DELETE=8 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:02:56 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=79,cinder:SELECT=58,cinder:DELETE=6,cinder:INSERT=17 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Flow 'volume_create_manager' (2bcbf171-79d9-4bc1-8ac1-f69990e4412a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8235aeb-03c6-41dd-85cb-9a7ab8b2f88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8235aeb-03c6-41dd-85cb-9a7ab8b2f88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-338992007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4efed74-23fc-4e4e-b281-3c22aa7e90ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc0d8f7240774af6b3e9d31ed42f007e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:10Z,use_quota=True,user_id='c289120707f847caad6eae9292826385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3be9b2f-1a45-4771-a05e-9387ae0b1f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3be9b2f-1a45-4771-a05e-9387ae0b1f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0813ed5b-4cbb-45d1-b4af-bcb42649c00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0813ed5b-4cbb-45d1-b4af-bcb42649c00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4efed74-23fc-4e4e-b281-3c22aa7e90ce', 'volume_name': 'volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2035045-7f08-44c5-8228-ae3d161dfc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2035045-7f08-44c5-8228-ae3d161dfc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87c2554-ee0b-4493-9246-806fa97a34ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:10 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Volume e4efed74-23fc-4e4e-b281-3c22aa7e90ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce', 'volume_size': 1} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-338992007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4efed74-23fc-4e4e-b281-3c22aa7e90ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc0d8f7240774af6b3e9d31ed42f007e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:10Z,use_quota=True,user_id='c289120707f847caad6eae9292826385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Creating volume e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:03:10 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:03:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:10 devstack sudo[114017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce 1073741824 Jun 23 13:03:10 devstack sudo[114017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:11 devstack sudo[114017]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce 1073741824" returned: 0 in 0.879s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:11 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce Jun 23 13:03:11 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:12 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" returned: 0 in 0.685s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87c2554-ee0b-4493-9246-806fa97a34ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9c76a3-3032-4da7-8e27-6faee0ba4072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:12 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Volume volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce (e4efed74-23fc-4e4e-b281-3c22aa7e90ce): created successfully Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9c76a3-3032-4da7-8e27-6faee0ba4072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Flow 'volume_create_manager' (2bcbf171-79d9-4bc1-8ac1-f69990e4412a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f28620cc-ff82-403d-b50a-60a7d1f2402f tempest-SnapshotDependencyTests-969505980 None] Created volume successfully. Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:13 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Creating offline snapshot 25038ccd-60a9-4d1c-b7de-9268e23fa5cd of volume e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:03:13 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a81c3d-76be-4695-8d4b-7cdc52fe3ec3]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:13 devstack sudo[114026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce Jun 23 13:03:13 devstack sudo[114026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:13 devstack sudo[114026]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" returned: 0 in 0.815s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:13 devstack sudo[114031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd 1G Jun 23 13:03:13 devstack sudo[114031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:14 devstack sudo[114031]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd 1G" returned: 0 in 0.855s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:14 devstack sudo[114072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd Jun 23 13:03:14 devstack sudo[114072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:15 devstack sudo[114072]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd" returned: 0 in 0.802s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:15 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd is being set with open permissions: ugo+rw Jun 23 13:03:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:15 devstack sudo[114077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd Jun 23 13:03:15 devstack sudo[114077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:16 devstack sudo[114077]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd" returned: 0 in 0.723s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:16 devstack sudo[114080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.info Jun 23 13:03:16 devstack sudo[114080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:16 devstack sudo[114080]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.info" returned: 0 in 0.669s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:16 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.info is being set with open permissions: ugo+rw Jun 23 13:03:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:16 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.info Jun 23 13:03:16 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:17 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.info" returned: 0 in 0.668s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.643s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-539a229d-5cee-4d1b-85c6-4f00a54abf29 tempest-SnapshotDependencyTests-969505980 None] Create snapshot completed successfully Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Flow 'volume_create_manager' (5fa1e817-03f4-4349-bcc9-96c87055b957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95752908-f190-4675-a347-3c447b6cb047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95752908-f190-4675-a347-3c447b6cb047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc0d8f7240774af6b3e9d31ed42f007e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25038ccd-60a9-4d1c-b7de-9268e23fa5cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:19Z,use_quota=True,user_id='c289120707f847caad6eae9292826385',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad5c1d-0a2c-45d2-a4a5-b99f7eeedb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ad5c1d-0a2c-45d2-a4a5-b99f7eeedb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af32b77f-7f29-4da8-86e6-49162da8807f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af32b77f-7f29-4da8-86e6-49162da8807f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86', 'volume_name': 'volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86', 'volume_size': 1, 'snapshot_id': '25038ccd-60a9-4d1c-b7de-9268e23fa5cd'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e72591-dd2a-46c9-8575-f8632a1922ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28e72591-dd2a-46c9-8575-f8632a1922ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cfd12b-3a9b-49e9-bef7-eefef14f0407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:18 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Volume 26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86', 'volume_size': 1, 'snapshot_id': '25038ccd-60a9-4d1c-b7de-9268e23fa5cd'} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-quobyte-25038ccd-60a9-4d1c-b7de-9268e23fa5cd-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-25038ccd-60a9-4d1c-b7de-9268e23fa5cd-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Creating volume 26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 from snapshot 25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-quobyte-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] snapshot: 25038ccd-60a9-4d1c-b7de-9268e23fa5cd, volume: 26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1475c22-22e9-40e8-b0c8-45e24a90a18f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:19 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd Jun 23 13:03:19 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:19 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd" returned: 0 in 0.858s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af6cac2-b553-449a-9451-d20b23ef7324]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:20 devstack sudo[114092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce Jun 23 13:03:20 devstack sudo[114092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:20 devstack sudo[114092]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" returned: 0 in 0.873s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:20 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 13:03:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:20 devstack sudo[114097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 Jun 23 13:03:20 devstack sudo[114097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:03:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:22 devstack sudo[114110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:03:22 devstack sudo[114110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:23 devstack sudo[114110]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.519s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:03:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:03:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:03:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:03:25 devstack sudo[114097]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" returned: 0 in 4.759s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:25 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2439573a-2bc6-4aac-9888-135c0ad1c389]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:25 devstack sudo[114113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce Jun 23 13:03:25 devstack sudo[114113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:26 devstack sudo[114113]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" returned: 0 in 0.942s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:26 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:03:26 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Converted 1024.00 MB image at 215.13 MB/s Jun 23 13:03:26 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 is being set with open permissions: ugo+rw Jun 23 13:03:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:26 devstack sudo[114118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 Jun 23 13:03:26 devstack sudo[114118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:27 devstack sudo[114118]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" returned: 0 in 0.678s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" released by "_copy_volume_from_snapshot" :: held 8.205s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-25038ccd-60a9-4d1c-b7de-9268e23fa5cd-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" released by "_create_volume_from_snapshot" :: held 8.233s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.252s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cfd12b-3a9b-49e9-bef7-eefef14f0407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86', 'volume_size': 1, 'snapshot_id': '25038ccd-60a9-4d1c-b7de-9268e23fa5cd'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaef52c0-71ca-421d-b7f9-c97d4228d38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Volume volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 (26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86): created successfully Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaef52c0-71ca-421d-b7f9-c97d4228d38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Flow 'volume_create_manager' (5fa1e817-03f4-4349-bcc9-96c87055b957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b8356c1e-02c8-488f-8511-d770743a7543 tempest-SnapshotDependencyTests-969505980 None] Created volume successfully. Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-25038ccd-60a9-4d1c-b7de-9268e23fa5cd-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-25038ccd-60a9-4d1c-b7de-9268e23fa5cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-quobyte-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-quobyte-25038ccd-60a9-4d1c-b7de-9268e23fa5cd" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-25038ccd-60a9-4d1c-b7de-9268e23fa5cd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Deleting offline snapshot 25038ccd-60a9-4d1c-b7de-9268e23fa5cd of volume e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] snapshot_file for this snap is: volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf3c5b-8e84-4c2f-b7af-aee9ae25ba79]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:27 devstack sudo[114121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd Jun 23 13:03:27 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:28 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd" returned: 0 in 0.742s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:28 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:03:28 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eca6ce7-0bb9-4039-b7b5-7c0eba1efe33]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:28 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:28 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce Jun 23 13:03:28 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:29 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" returned: 0 in 0.739s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:29 devstack sudo[114138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd Jun 23 13:03:29 devstack sudo[114138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:29 devstack sudo[114138]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd" returned: 0 in 0.704s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:29 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd Jun 23 13:03:29 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:30 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce.25038ccd-60a9-4d1c-b7de-9268e23fa5cd" returned: 0 in 0.614s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-25038ccd-60a9-4d1c-b7de-9268e23fa5cd" released by "_delete_snapshot" :: held 2.893s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" released by "delete_snapshot" :: held 2.913s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Created reservations ['6829381f-008a-42d3-98c4-5139e616d08f', 'b4fa7fe9-4111-4134-8d66-9ca12166bc18', '4c8da3e9-52f5-4250-85b3-6a046c489c30', 'cc4bcbdc-1e7e-4733-9b58-84d120f8b556'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:03:30 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Delete snapshot completed successfully. Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-82201ee5-c455-4899-a4fa-6209c58deffe tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-25038ccd-60a9-4d1c-b7de-9268e23fa5cd-delete_snapshot" released by "delete_snapshot" :: held 3.033s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-e4efed74-23fc-4e4e-b281-3c22aa7e90ce-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-e4efed74-23fc-4e4e-b281-3c22aa7e90ce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-quobyte-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad7604c-df5a-4b16-89bb-eb4ce2faebc5]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:31 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce Jun 23 13:03:31 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:31 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" returned: 0 in 0.727s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:31 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce Jun 23 13:03:31 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:32 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" returned: 0 in 0.618s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-e4efed74-23fc-4e4e-b281-3c22aa7e90ce" released by "delete_volume" :: held 1.398s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Created reservations ['6e7f6a55-0199-4a66-9cea-17686d174c9c', '2ac40c64-3c1e-47cd-8e68-ace7056552d0', '9773a56c-de81-47af-b318-42e1973acddb', 'd0adf0e2-bd64-423e-9418-2faea08c989d'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:32 devstack sudo[114154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:03:32 devstack sudo[114154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:33 devstack sudo[114154]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.633s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:03:33 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Deleted volume successfully. Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9e187c95-872c-4a6e-82a6-0c714cc4f9f3 tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-e4efed74-23fc-4e4e-b281-3c22aa7e90ce-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "cinder-quobyte-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba6a99b-65de-4a3a-ad6c-376e4698e376]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:33 devstack sudo[114157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 Jun 23 13:03:33 devstack sudo[114157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:33 devstack sudo[114157]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" returned: 0 in 0.744s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:33 devstack sudo[114162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86 Jun 23 13:03:33 devstack sudo[114162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:34 devstack sudo[114162]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" returned: 0 in 0.686s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-quobyte-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86" released by "delete_volume" :: held 1.470s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Created reservations ['ce5fa343-fe38-4d42-be7e-8061e3449028', '9963093a-6ba8-4889-b8ec-ebc247101abd', '1c2a5e2c-cdca-46c2-8801-07ee99a512d4', 'cd315acf-ed60-4b86-9c17-44cf7f5758e7'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:34 devstack sudo[114165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:03:34 devstack sudo[114165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:35 devstack sudo[114165]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.692s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:35 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:03:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Deleted volume successfully. Jun 23 13:03:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-52e8a600-3e1c-44f2-83a5-9dbb72906cbd tempest-SnapshotDependencyTests-969505980 None] Lock "cinder-26aa047d-f8b5-42ae-aa2d-c7bdc25c6e86-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:03:44 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=31,cinder:SELECT=22,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:03:45 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (82c290eb-aec2-4531-8b01-32b3cd966d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99accee-4d9c-47dd-b6d8-998bfed0189c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99accee-4d9c-47dd-b6d8-998bfed0189c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331607793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2893c1-1a83-4762-be99-7b7dcdb0bd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:55Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62126dc7-206c-4c2e-a308-b10aa825a6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62126dc7-206c-4c2e-a308-b10aa825a6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a8cd87-09c8-4f0f-b8a4-66d078b7c6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a8cd87-09c8-4f0f-b8a4-66d078b7c6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2893c1-1a83-4762-be99-7b7dcdb0bd40', 'volume_name': 'volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd34c5c-9b52-4dec-81c5-6dfa333669a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dd34c5c-9b52-4dec-81c5-6dfa333669a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1a0b8f-354d-42de-bd1e-2371959ab429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume da2893c1-1a83-4762-be99-7b7dcdb0bd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40', 'volume_size': 1} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331607793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2893c1-1a83-4762-be99-7b7dcdb0bd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:55Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Creating volume da2893c1-1a83-4762-be99-7b7dcdb0bd40 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:03:55 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:55 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 1073741824 Jun 23 13:03:55 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (02927a7c-4da8-45c7-8f75-8e2585c49e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acde78fb-ef58-432b-9894-e6538b544437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acde78fb-ef58-432b-9894-e6538b544437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809572049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9147fa4f-60a1-40eb-8948-b0b1971435c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:55Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf03b817-28d8-4701-9a11-6dec9c42635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf03b817-28d8-4701-9a11-6dec9c42635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a170ae5-6b77-4457-b6de-7c84b11303e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a170ae5-6b77-4457-b6de-7c84b11303e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9147fa4f-60a1-40eb-8948-b0b1971435c4', 'volume_name': 'volume-9147fa4f-60a1-40eb-8948-b0b1971435c4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12586296-4658-4baa-96ae-385a5d6905b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12586296-4658-4baa-96ae-385a5d6905b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae939b59-5459-4168-a69f-9eb2394f3c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Volume 9147fa4f-60a1-40eb-8948-b0b1971435c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9147fa4f-60a1-40eb-8948-b0b1971435c4', 'volume_size': 1} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (02d47306-b407-4333-98df-c96d242c72f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca4ea98-e7d5-4632-99da-2b0a246f1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca4ea98-e7d5-4632-99da-2b0a246f1947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270714341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb78818-57be-4949-9a75-adf6875f0dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c7ca3b-d585-4900-89a9-1365e1c2af30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c7ca3b-d585-4900-89a9-1365e1c2af30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ed3445-aa31-43bc-a8cb-4f6030b3df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ed3445-aa31-43bc-a8cb-4f6030b3df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb78818-57be-4949-9a75-adf6875f0dc8', 'volume_name': 'volume-9fb78818-57be-4949-9a75-adf6875f0dc8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a05934-2a1f-437e-9535-2b8f93b2c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a05934-2a1f-437e-9535-2b8f93b2c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0aeb8b5-d919-43c7-91fe-b2cc697660ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:55 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Volume 9fb78818-57be-4949-9a75-adf6875f0dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb78818-57be-4949-9a75-adf6875f0dc8', 'volume_size': 1} Jun 23 13:03:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Flow 'volume_create_manager' (e5a5e308-0fcc-41df-bfea-e45ffc9cc632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6dc71d-07d4-442f-b574-6fe71678cdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6dc71d-07d4-442f-b574-6fe71678cdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1491735386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af126a762454a0e8502265ecb2537ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='b0dfdeacfbe94491ba357bb62a1b8adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb1f894-3620-434b-a718-8b7c39c1b58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acb1f894-3620-434b-a718-8b7c39c1b58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05baaeed-5030-45bc-800d-649d9dd8566e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05baaeed-5030-45bc-800d-649d9dd8566e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1', 'volume_name': 'volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dc064a-3703-4d3b-a2a5-a51c59de84b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dc064a-3703-4d3b-a2a5-a51c59de84b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbe83fa-ae7c-403c-8479-c16f431efcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Volume 361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1', 'volume_size': 1} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (3a6aef31-8e3f-4c94-afe8-b7b6d2f6b4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcff5dc5-7a4d-4b85-a3ec-220edfc09de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcff5dc5-7a4d-4b85-a3ec-220edfc09de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379162862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eeb3cd-a9e5-409e-925e-85554347e79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ed1afa-34bb-4dc5-9f6e-38586ef42782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ed1afa-34bb-4dc5-9f6e-38586ef42782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d760315-5f3e-4413-bcc1-65b21ee90d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d760315-5f3e-4413-bcc1-65b21ee90d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7eeb3cd-a9e5-409e-925e-85554347e79b', 'volume_name': 'volume-d7eeb3cd-a9e5-409e-925e-85554347e79b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e19bd1-05ee-4fcd-8585-8b2764087fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e19bd1-05ee-4fcd-8585-8b2764087fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe87872-acf8-4d77-8b84-e43d0d792941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Volume d7eeb3cd-a9e5-409e-925e-85554347e79b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7eeb3cd-a9e5-409e-925e-85554347e79b', 'volume_size': 1} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (44321356-cd57-4858-822c-1a3520c6d7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911a6e0d-6040-4587-910a-6789b8ae7b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911a6e0d-6040-4587-910a-6789b8ae7b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157574843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88610fe0-5c44-41f0-9044-cf709a49287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88610fe0-5c44-41f0-9044-cf709a49287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f13ac15-a251-4b66-9c10-aa405b5e12e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f13ac15-a251-4b66-9c10-aa405b5e12e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8', 'volume_name': 'volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b12d41-315a-46e2-bd93-8d63f9a50b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b12d41-315a-46e2-bd93-8d63f9a50b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b27e23e-0d48-437f-afcb-3531525f445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Volume 69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8', 'volume_size': 1} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 1073741824" returned: 0 in 1.439s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:56 devstack sudo[114227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 Jun 23 13:03:56 devstack sudo[114227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (05bae113-7137-4780-82d8-d05d0a6dc001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3785e244-261d-4535-8a35-c4f25c4ffe2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3785e244-261d-4535-8a35-c4f25c4ffe2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27199031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162a71d8-6760-4b03-96cd-bb13deef706f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:57Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebaef0eb-5db6-4bb7-aa32-67b5e348ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebaef0eb-5db6-4bb7-aa32-67b5e348ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf58e537-3b88-4e3f-a655-5c5774f1cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf58e537-3b88-4e3f-a655-5c5774f1cc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162a71d8-6760-4b03-96cd-bb13deef706f', 'volume_name': 'volume-162a71d8-6760-4b03-96cd-bb13deef706f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb42fc6-89ca-4da2-9b86-6c9da57d2e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb42fc6-89ca-4da2-9b86-6c9da57d2e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4ecd1a-fd0f-41c8-a93f-c74e16e98c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Volume 162a71d8-6760-4b03-96cd-bb13deef706f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162a71d8-6760-4b03-96cd-bb13deef706f', 'volume_size': 1} Jun 23 13:03:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:57 devstack sudo[114227]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40" returned: 0 in 0.706s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.204s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1809572049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9147fa4f-60a1-40eb-8948-b0b1971435c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:55Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Creating volume 9147fa4f-60a1-40eb-8948-b0b1971435c4 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:03:57 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:57 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 1073741824 Jun 23 13:03:57 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1a0b8f-354d-42de-bd1e-2371959ab429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322c2c66-5e01-479e-874a-c9d9dc71095b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:57 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 (da2893c1-1a83-4762-be99-7b7dcdb0bd40): created successfully Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322c2c66-5e01-479e-874a-c9d9dc71095b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:57 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (82c290eb-aec2-4531-8b01-32b3cd966d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:57 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4d6aed4b-86c9-4852-9dad-89e78bf222d4 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created volume successfully. Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (f094f460-18e5-4b9a-bf1c-27f508fa0d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193d74a2-dee0-4012-a016-af3bbbcad2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (193d74a2-dee0-4012-a016-af3bbbcad2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692950590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad472f9-3a66-4c72-9003-fdd1b0aa8113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:58Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ca79a5-6462-42aa-88e8-3e4a573a55fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ca79a5-6462-42aa-88e8-3e4a573a55fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4339b8-5219-4be5-a2e7-77ae1176950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4339b8-5219-4be5-a2e7-77ae1176950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad472f9-3a66-4c72-9003-fdd1b0aa8113', 'volume_name': 'volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c850fc0e-c79d-4aa1-b1cf-b43a7c7973aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c850fc0e-c79d-4aa1-b1cf-b43a7c7973aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a943f382-0d7e-4776-b516-1a33a29c4ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume 8ad472f9-3a66-4c72-9003-fdd1b0aa8113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113', 'volume_size': 1} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:58 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 1073741824" returned: 0 in 1.002s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:58 devstack sudo[114236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 Jun 23 13:03:58 devstack sudo[114236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (1f7f04c1-b65a-4d2c-bf6f-f4e980e93702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614707e7-7dd4-4fe1-9e26-787bde2c05fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614707e7-7dd4-4fe1-9e26-787bde2c05fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234263692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ba8122-5b75-4c8c-a551-d7f0657bf098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:59Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f1b187-08e2-4298-8583-aef949a8388b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17f1b187-08e2-4298-8583-aef949a8388b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2391a2c7-ba07-45bd-8cb3-62cee994e90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2391a2c7-ba07-45bd-8cb3-62cee994e90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ba8122-5b75-4c8c-a551-d7f0657bf098', 'volume_name': 'volume-36ba8122-5b75-4c8c-a551-d7f0657bf098', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca69ed1-51c0-4289-a09b-f4de82a2e9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca69ed1-51c0-4289-a09b-f4de82a2e9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663ee261-d28a-46a0-b670-8d04d92631bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume 36ba8122-5b75-4c8c-a551-d7f0657bf098: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ba8122-5b75-4c8c-a551-d7f0657bf098', 'volume_size': 1} Jun 23 13:03:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:59 devstack sudo[114236]: pam_unix(sudo:session): session closed for user root Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4" returned: 0 in 0.809s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] <== create_volume: return (1863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.662s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-270714341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb78818-57be-4949-9a75-adf6875f0dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Creating volume 9fb78818-57be-4949-9a75-adf6875f0dc8 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:03:59 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae939b59-5459-4168-a69f-9eb2394f3c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9147fa4f-60a1-40eb-8948-b0b1971435c4', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a1f65-d496-4f44-80df-9ea87eedc258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack sudo[114239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 1073741824 Jun 23 13:03:59 devstack sudo[114239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:03:59 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Volume volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 (9147fa4f-60a1-40eb-8948-b0b1971435c4): created successfully Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a1f65-d496-4f44-80df-9ea87eedc258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (02927a7c-4da8-45c7-8f75-8e2585c49e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:59 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-1548e56f-ff42-4526-89e6-380b96a1dbd0 tempest-CreateVolumesFromImageTest-601505983 None] Created volume successfully. Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (fb526160-e171-402e-89da-97ee04e2f724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69b9b43-0179-4e88-98ee-d6b232e7ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69b9b43-0179-4e88-98ee-d6b232e7ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-760030153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234ad557-70d9-4c5c-bd4b-b24d5a2b06c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:59Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca16ea8-a349-4f3d-92b6-0e15b2fbb44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aca16ea8-a349-4f3d-92b6-0e15b2fbb44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6190f79-9222-4152-8c34-a97339f9416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6190f79-9222-4152-8c34-a97339f9416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '234ad557-70d9-4c5c-bd4b-b24d5a2b06c5', 'volume_name': 'volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c3197f-57ef-4502-addc-0b90e0512a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20c3197f-57ef-4502-addc-0b90e0512a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5c44b0-57b4-484f-b7bb-bb59bf16bfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume 234ad557-70d9-4c5c-bd4b-b24d5a2b06c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5', 'volume_size': 1} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Flow 'volume_create_manager' (6abb8a98-0b0f-46a1-a65c-3aa0b416d6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cac707-a5ad-470b-a02f-8f576fed2afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13cac707-a5ad-470b-a02f-8f576fed2afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0758cd-0ead-4a20-9e50-6aaae8b8829e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b460403e804d59b90692059a9684df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:00Z,use_quota=True,user_id='24507fd9b6c54a78b47f57f611d2542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eea9a7d5-827d-41b8-af1f-f2b6db7f88d3),volume_type_id=eea9a7d5-827d-41b8-af1f-f2b6db7f88d3)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6bbb2b-a3ed-4d0f-9957-aca24b7b2d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6bbb2b-a3ed-4d0f-9957-aca24b7b2d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c15aaa-f258-4629-a369-863e21d523fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (1b5cf4b5-ea61-4d0f-bd7a-7ede92b0c834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:03:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f785ed8f-53da-4502-a0ec-12e2a8829b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f785ed8f-53da-4502-a0ec-12e2a8829b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686697765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:00Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb8d555-675a-4b53-85a4-94f64f83e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb8d555-675a-4b53-85a4-94f64f83e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38275971-13d6-48db-9f67-a099a833d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38275971-13d6-48db-9f67-a099a833d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff', 'volume_name': 'volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039dad22-2600-4543-b637-2ea9c3c53c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039dad22-2600-4543-b637-2ea9c3c53c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6835a65c-c6da-4e62-b456-e03841c66460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff', 'volume_size': 1} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (606e6c3f-aa2e-433b-a21c-c9fde0a10dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10aa185e-9ffb-43b6-a752-fd67b8c3ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10aa185e-9ffb-43b6-a752-fd67b8c3ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107182462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a90992-831e-4f1e-9654-322ae01dbd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:00Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ff30b7-74f0-4fad-91e6-5b6e930e1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ff30b7-74f0-4fad-91e6-5b6e930e1353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7ce8a-0647-49bb-a732-2d936714f370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da7ce8a-0647-49bb-a732-2d936714f370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a90992-831e-4f1e-9654-322ae01dbd27', 'volume_name': 'volume-51a90992-831e-4f1e-9654-322ae01dbd27', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7add5519-f2b3-459b-a1e3-232e0093e41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7add5519-f2b3-459b-a1e3-232e0093e41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f338e81a-bed8-42f0-877c-4e80fa801945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume 51a90992-831e-4f1e-9654-322ae01dbd27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a90992-831e-4f1e-9654-322ae01dbd27', 'volume_size': 1} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26c15aaa-f258-4629-a369-863e21d523fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba0758cd-0ead-4a20-9e50-6aaae8b8829e', 'volume_name': 'volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e', 'volume_size': 1, 'image_id': 'f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '579455b38f7cbd7eeb18806756989578', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b460403e804d59b90692059a9684df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ab3c30d8289564ada57ce3e6db9a2a7f018a81e5e803f504de3f817bec051c56e6eb1ac62918b8ae30b655d32bb8af14e75e600aeb7861ef6143fded4e4068a', 'id': 'f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'created_at': datetime.datetime(2026, 6, 23, 11, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 3, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2def1577-7a35-4503-8823-114c4ebe8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2def1577-7a35-4503-8823-114c4ebe8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66420ba9-a4e1-400a-9543-65d8c4e2871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:00 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Volume ba0758cd-0ead-4a20-9e50-6aaae8b8829e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e', 'volume_size': 1, 'image_id': 'f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '579455b38f7cbd7eeb18806756989578', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b460403e804d59b90692059a9684df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ab3c30d8289564ada57ce3e6db9a2a7f018a81e5e803f504de3f817bec051c56e6eb1ac62918b8ae30b655d32bb8af14e75e600aeb7861ef6143fded4e4068a', 'id': 'f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'created_at': datetime.datetime(2026, 6, 23, 11, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 3, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Trying to clone ba0758cd-0ead-4a20-9e50-6aaae8b8829e from image f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 13:04:00 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Image download 0.00 MB at 0.00 MB/s Jun 23 13:04:00 devstack sudo[114239]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 1073741824" returned: 0 in 1.023s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0966743b-105e-4a10-a49d-8927f9412b87]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:00 devstack sudo[114248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 Jun 23 13:04:00 devstack sudo[114248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:00 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD Jun 23 13:04:00 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:01 devstack sudo[114248]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8" returned: 0 in 0.660s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.858s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1491735386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af126a762454a0e8502265ecb2537ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='b0dfdeacfbe94491ba357bb62a1b8adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Creating volume 361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:01 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:01 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:01 devstack sudo[114254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 1073741824 Jun 23 13:04:01 devstack sudo[114254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0aeb8b5-d919-43c7-91fe-b2cc697660ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb78818-57be-4949-9a75-adf6875f0dc8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e75845d-cb4a-44c2-8ba1-375d98aa0803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:01 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Volume volume-9fb78818-57be-4949-9a75-adf6875f0dc8 (9fb78818-57be-4949-9a75-adf6875f0dc8): created successfully Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e75845d-cb4a-44c2-8ba1-375d98aa0803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (02d47306-b407-4333-98df-c96d242c72f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:01 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9cdb7d46-7bff-4d17-a945-c80426328e34 tempest-CreateVolumesFromImageTest-601505983 None] Created volume successfully. Jun 23 13:04:01 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD Jun 23 13:04:01 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:01 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD" returned: 1 in 0.789s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:01 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Temporary image f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 is fetched for user 24507fd9b6c54a78b47f57f611d2542d. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 13:04:02 devstack sudo[114254]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 1073741824" returned: 0 in 0.872s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ad884-2371-4cd8-b7c3-e372789ffbe1]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:02 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 Jun 23 13:04:02 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:02 devstack sudo[114265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD Jun 23 13:04:02 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:02 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" returned: 0 in 0.716s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.237s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-379162862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eeb3cd-a9e5-409e-925e-85554347e79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Creating volume d7eeb3cd-a9e5-409e-925e-85554347e79b {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:02 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:02 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b 1073741824 Jun 23 13:04:02 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fbe83fa-ae7c-403c-8479-c16f431efcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de99bbb0-ee8b-4c91-9a30-ff4cb8963b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:02 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Volume volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 (361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1): created successfully Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de99bbb0-ee8b-4c91-9a30-ff4cb8963b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Flow 'volume_create_manager' (e5a5e308-0fcc-41df-bfea-e45ffc9cc632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:02 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-905a9d82-e2e8-4af4-9fe1-1875fa044e4c tempest-VolumeDependencyTests-632277257 None] Created volume successfully. Jun 23 13:04:02 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:03 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD Jun 23 13:04:03 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:03 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b 1073741824" returned: 0 in 0.916s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:03 devstack sudo[114279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b Jun 23 13:04:03 devstack sudo[114279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:03 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD" returned: 1 in 0.936s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:04 devstack sudo[114279]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b" returned: 0 in 0.634s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.626s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157574843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:56Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Creating volume 69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:04 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe87872-acf8-4d77-8b84-e43d0d792941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7eeb3cd-a9e5-409e-925e-85554347e79b', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:04 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 1073741824 Jun 23 13:04:04 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb29bba-9e33-4662-b400-676fe12fac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:04 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Volume volume-d7eeb3cd-a9e5-409e-925e-85554347e79b (d7eeb3cd-a9e5-409e-925e-85554347e79b): created successfully Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb29bba-9e33-4662-b400-676fe12fac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:04 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (3a6aef31-8e3f-4c94-afe8-b7b6d2f6b4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:04 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d0bbbb4a-cfc2-4434-92c3-db16a9999efe tempest-CreateVolumesFromImageTest-601505983 None] Created volume successfully. Jun 23 13:04:05 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 1073741824" returned: 0 in 0.851s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:05 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 Jun 23 13:04:05 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:05 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8" returned: 0 in 0.651s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-27199031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162a71d8-6760-4b03-96cd-bb13deef706f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d8e11eda1a4f1a9f204c1e0c8a0fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:57Z,use_quota=True,user_id='67176b122062451bae83666ae9ab811b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Creating volume 162a71d8-6760-4b03-96cd-bb13deef706f {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:05 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:05 devstack sudo[114294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f 1073741824 Jun 23 13:04:05 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b27e23e-0d48-437f-afcb-3531525f445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:05 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57956df-711c-49d1-81ee-627d72700b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:06 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Volume volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 (69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8): created successfully Jun 23 13:04:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57956df-711c-49d1-81ee-627d72700b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (44321356-cd57-4858-822c-1a3520c6d7fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:06 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c0f2f77d-f6da-407e-b58a-8e04048333e9 tempest-CreateVolumesFromImageTest-601505983 None] Created volume successfully. Jun 23 13:04:06 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f 1073741824" returned: 0 in 0.800s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:06 devstack sudo[114300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f Jun 23 13:04:06 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:07 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f" returned: 0 in 0.628s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.931s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-692950590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad472f9-3a66-4c72-9003-fdd1b0aa8113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:58Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Creating volume 8ad472f9-3a66-4c72-9003-fdd1b0aa8113 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:07 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4ecd1a-fd0f-41c8-a93f-c74e16e98c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162a71d8-6760-4b03-96cd-bb13deef706f', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:07 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 1073741824 Jun 23 13:04:07 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88186ae5-93e0-46c8-8844-46055657b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:07 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Volume volume-162a71d8-6760-4b03-96cd-bb13deef706f (162a71d8-6760-4b03-96cd-bb13deef706f): created successfully Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88186ae5-93e0-46c8-8844-46055657b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:07 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Flow 'volume_create_manager' (05bae113-7137-4780-82d8-d05d0a6dc001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0c3fbd57-f67d-47ef-9186-893b8234a806 tempest-CreateVolumesFromImageTest-601505983 None] Created volume successfully. Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-162a71d8-6760-4b03-96cd-bb13deef706f-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-162a71d8-6760-4b03-96cd-bb13deef706f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-quobyte-162a71d8-6760-4b03-96cd-bb13deef706f" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-162a71d8-6760-4b03-96cd-bb13deef706f" acquired by "delete_volume" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59e370e-216a-49a3-b506-e3171ae5beeb]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:08 devstack sudo[114309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f Jun 23 13:04:08 devstack sudo[114309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:08 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 1073741824" returned: 0 in 0.907s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:08 devstack sudo[114311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 Jun 23 13:04:08 devstack sudo[114311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:08 devstack sudo[114309]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f" returned: 0 in 0.803s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:08 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f Jun 23 13:04:08 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:09 devstack sudo[114311]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113" returned: 0 in 0.723s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.144s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-234263692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36ba8122-5b75-4c8c-a551-d7f0657bf098,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:59Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Creating volume 36ba8122-5b75-4c8c-a551-d7f0657bf098 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:09 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:09 devstack sudo[114319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 1073741824 Jun 23 13:04:09 devstack sudo[114319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a943f382-0d7e-4776-b516-1a33a29c4ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94fe1d3-557d-4cce-be9a-666a48f761b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:09 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 (8ad472f9-3a66-4c72-9003-fdd1b0aa8113): created successfully Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c94fe1d3-557d-4cce-be9a-666a48f761b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (f094f460-18e5-4b9a-bf1c-27f508fa0d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8ac8738f-e000-4aa2-9a4b-9ff8e8a7937e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created volume successfully. Jun 23 13:04:09 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-162a71d8-6760-4b03-96cd-bb13deef706f" returned: 0 in 0.683s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-162a71d8-6760-4b03-96cd-bb13deef706f" released by "delete_volume" :: held 1.538s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Created reservations ['3ac4797e-22ee-4cea-b7c5-a4428fa00ef5', '73aacca1-a6b5-4fa8-935a-9dfbe1aced05', '85dcdffe-dda8-4310-b983-724d07b4dfd3', '96fb0543-b13a-4329-ac65-ca60b08c18ef'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:09 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:09 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:10 devstack sudo[114319]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 1073741824" returned: 0 in 0.920s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:10 devstack sudo[114328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 Jun 23 13:04:10 devstack sudo[114328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-quobyte-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0f6b3-b0dd-452e-82ba-f0be396958c0]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:10 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.708s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Deleted volume successfully. Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f42e7ca1-5515-4f0b-b6bf-c10d03e94aee tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-162a71d8-6760-4b03-96cd-bb13deef706f-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:10 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 Jun 23 13:04:10 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:10 devstack sudo[114328]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098" returned: 0 in 0.723s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.161s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-760030153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=234ad557-70d9-4c5c-bd4b-b24d5a2b06c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:03:59Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Creating volume 234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:10 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663ee261-d28a-46a0-b670-8d04d92631bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ba8122-5b75-4c8c-a551-d7f0657bf098', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81d7a52-01e1-4700-b893-c2cba66d9f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:10 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 1073741824 Jun 23 13:04:10 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:10 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 (36ba8122-5b75-4c8c-a551-d7f0657bf098): created successfully Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81d7a52-01e1-4700-b893-c2cba66d9f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:10 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (1f7f04c1-b65a-4d2c-bf6f-f4e980e93702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ae007947-c1e0-46dd-a8d8-102a6b18008b tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created volume successfully. Jun 23 13:04:11 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8" returned: 0 in 0.824s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:11 devstack sudo[114339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8 Jun 23 13:04:11 devstack sudo[114339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:11 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 1073741824" returned: 0 in 0.936s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:11 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 Jun 23 13:04:11 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:11 devstack sudo[114339]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8" returned: 0 in 0.645s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:11 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8" released by "delete_volume" :: held 1.523s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:11 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Created reservations ['c25cf530-1f78-4273-b976-e0c72ccfe8bb', '271a9020-a3c2-4509-8740-711eb0ae786a', '6fc9eae4-a6cb-431f-9e04-9d85ff846324', '205f4232-2944-4cf2-bc98-2a6bf3ff34f6'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:12 devstack sudo[114348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:12 devstack sudo[114348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:12 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5" returned: 0 in 0.673s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.440s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686697765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:00Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Creating volume fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:12 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5c44b0-57b4-484f-b7bb-bb59bf16bfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:12 devstack sudo[114352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff 1073741824 Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d6b769-da98-4e0c-80b4-0d141e2b0a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:12 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:12 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 (234ad557-70d9-4c5c-bd4b-b24d5a2b06c5): created successfully Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d6b769-da98-4e0c-80b4-0d141e2b0a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (fb526160-e171-402e-89da-97ee04e2f724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-d7eeb3cd-a9e5-409e-925e-85554347e79b-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9582a8fa-7b91-4cc9-8e40-a5d714d17a43 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created volume successfully. Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-d7eeb3cd-a9e5-409e-925e-85554347e79b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-quobyte-d7eeb3cd-a9e5-409e-925e-85554347e79b" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-d7eeb3cd-a9e5-409e-925e-85554347e79b" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b27e3d7-3c4f-4e76-89c8-df8a7c75ee59]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:12 devstack sudo[114348]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.729s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:12 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Deleted volume successfully. Jun 23 13:04:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-365ba5a5-e21b-4749-bf1e-cd007c8cbc79 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-69da36fd-dd7c-46fb-80ad-4c8fb6a6f0f8-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:12 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b Jun 23 13:04:12 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:13 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff 1073741824" returned: 0 in 0.975s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:13 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff Jun 23 13:04:13 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:13 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b" returned: 0 in 0.880s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:13 devstack sudo[114365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b Jun 23 13:04:13 devstack sudo[114365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:14 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff" returned: 0 in 0.628s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.878s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2107182462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a90992-831e-4f1e-9654-322ae01dbd27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18b613e8b73f48f5ae1000ae80d710e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:00Z,use_quota=True,user_id='e5f8cb189e484cd9ab1859a7b7575351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Creating volume 51a90992-831e-4f1e-9654-322ae01dbd27 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:14 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:14 devstack sudo[114369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 1073741824 Jun 23 13:04:14 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6835a65c-c6da-4e62-b456-e03841c66460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17985b53-b7d7-4446-9e7c-672e5a9844a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:14 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff (fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff): created successfully Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17985b53-b7d7-4446-9e7c-672e5a9844a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (1b5cf4b5-ea61-4d0f-bd7a-7ede92b0c834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:14 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d5330ca2-268e-4d65-843a-003ed22768f9 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created volume successfully. Jun 23 13:04:14 devstack sudo[114365]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d7eeb3cd-a9e5-409e-925e-85554347e79b" returned: 0 in 0.670s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-d7eeb3cd-a9e5-409e-925e-85554347e79b" released by "delete_volume" :: held 1.603s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Created reservations ['9bb1ced5-3c8b-446e-b672-a59d2a142c75', '618b299a-45c7-4d07-9eaa-1fe2ed9ee952', '175f6d4f-a83c-465d-b2ce-99b5d730bc97', 'b1839e5c-94bb-4d4d-b7c3-c201af2f5592'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:14 devstack sudo[114405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:14 devstack sudo[114405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-9fb78818-57be-4949-9a75-adf6875f0dc8-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-9fb78818-57be-4949-9a75-adf6875f0dc8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-quobyte-9fb78818-57be-4949-9a75-adf6875f0dc8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-9fb78818-57be-4949-9a75-adf6875f0dc8" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0250e638-5e77-49d9-807e-de4cea7aed3b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:15 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 1073741824" returned: 0 in 0.949s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:15 devstack sudo[114414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 Jun 23 13:04:15 devstack sudo[114414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:15 devstack sudo[114405]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.733s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:15 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Deleted volume successfully. Jun 23 13:04:15 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 Jun 23 13:04:15 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b21c2098-69ce-4129-a802-d1429ca71557 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-d7eeb3cd-a9e5-409e-925e-85554347e79b-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:15 devstack sudo[114414]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8" returned: 0 in 0.819s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:15 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27" returned: 0 in 0.695s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.491s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:15 devstack sudo[114422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8 Jun 23 13:04:15 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f338e81a-bed8-42f0-877c-4e80fa801945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a90992-831e-4f1e-9654-322ae01dbd27', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e4e789-0a66-453e-947b-dcab3a97c9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Creating offline snapshot 4ac105e6-4e93-4bc1-b812-54a77a5e7871 of volume 361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:04:15 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Volume volume-51a90992-831e-4f1e-9654-322ae01dbd27 (51a90992-831e-4f1e-9654-322ae01dbd27): created successfully Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e4e789-0a66-453e-947b-dcab3a97c9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Flow 'volume_create_manager' (606e6c3f-aa2e-433b-a21c-c9fde0a10dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd298a6-fad6-4df4-adb7-94fa76c3ed78]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:15 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a059e933-2e5a-49cb-a744-4c2378115e0d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created volume successfully. Jun 23 13:04:16 devstack sudo[114424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 Jun 23 13:04:16 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:16 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-51a90992-831e-4f1e-9654-322ae01dbd27-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9fb78818-57be-4949-9a75-adf6875f0dc8" returned: 0 in 0.685s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-51a90992-831e-4f1e-9654-322ae01dbd27-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-9fb78818-57be-4949-9a75-adf6875f0dc8" released by "delete_volume" :: held 1.562s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-quobyte-51a90992-831e-4f1e-9654-322ae01dbd27" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-51a90992-831e-4f1e-9654-322ae01dbd27" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d9858b-ea37-4e35-93ac-3737ab691264]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Created reservations ['b855df80-4e45-47c1-abce-5d10608cd9b8', 'cefe58a4-abdb-46f7-919d-3e2546eac4ff', 'cda256b9-3246-4279-bff0-0c7b767cec1f', 'bc794f32-396f-4d48-aafe-55340d21f4ba'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:16 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 Jun 23 13:04:16 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:16 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" returned: 0 in 0.850s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:16 devstack sudo[114431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:16 devstack sudo[114431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:16 devstack sudo[114433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 1G Jun 23 13:04:16 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-9147fa4f-60a1-40eb-8948-b0b1971435c4-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-9147fa4f-60a1-40eb-8948-b0b1971435c4-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "cinder-quobyte-9147fa4f-60a1-40eb-8948-b0b1971435c4" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-9147fa4f-60a1-40eb-8948-b0b1971435c4" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd724cb-6745-41e5-afb1-2c751244cd5e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:17 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 Jun 23 13:04:17 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:17 devstack sudo[114431]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.795s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Deleted volume successfully. Jun 23 13:04:17 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27" returned: 0 in 0.929s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-ded970ed-a471-4cb2-9313-7a75063a474f tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-9fb78818-57be-4949-9a75-adf6875f0dc8-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:17 devstack sudo[114446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27 Jun 23 13:04:17 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:17 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 1G" returned: 0 in 1.090s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:17 devstack sudo[114449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 Jun 23 13:04:17 devstack sudo[114449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:18 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4" returned: 0 in 0.833s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:18 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4 Jun 23 13:04:18 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:18 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-51a90992-831e-4f1e-9654-322ae01dbd27" returned: 0 in 0.742s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-51a90992-831e-4f1e-9654-322ae01dbd27" released by "delete_volume" :: held 1.726s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created reservations ['86ea3dd4-de26-45dd-b11b-ac09f27a53fd', 'c0637631-6a2c-4b65-8f79-c75dacbc6774', '75d0a473-1f9a-45fa-a62b-bf7a6a0f90b0', '0c43bdba-af5e-43ff-8199-e3b5b8dd4c45'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:18 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:18 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:18 devstack sudo[114449]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871" returned: 0 in 0.741s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:18 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 is being set with open permissions: ugo+rw Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:18 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 Jun 23 13:04:18 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:18 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-9147fa4f-60a1-40eb-8948-b0b1971435c4" returned: 0 in 0.745s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-quobyte-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-quobyte-9147fa4f-60a1-40eb-8948-b0b1971435c4" released by "delete_volume" :: held 1.639s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[962fa172-d0c3-4762-b452-0515aab9bd71]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:18 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Created reservations ['30d3d186-e2cc-4897-a329-e7b08e8d6520', '269cd6a5-21de-4281-a322-acd2ff82a5da', 'b60a960b-956d-40d4-86a0-ede1fe30a0ae', 'c1dc5667-0e24-4902-a8a0-77ee0f1e37a8'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:19 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff Jun 23 13:04:19 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:19 devstack sudo[114466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:19 devstack sudo[114466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:19 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.767s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Deleted volume successfully. Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-7d18ba50-37e8-4123-8819-a96a744dd102 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-51a90992-831e-4f1e-9654-322ae01dbd27-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:19 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871" returned: 0 in 0.786s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:19 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.info Jun 23 13:04:19 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:19 devstack sudo[114466]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.767s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Deleted volume successfully. Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-25a00d12-b049-4191-bf9f-4384962719b9 tempest-CreateVolumesFromImageTest-601505983 None] Lock "cinder-9147fa4f-60a1-40eb-8948-b0b1971435c4-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:19 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff" returned: 0 in 0.967s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:19 devstack sudo[114477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff Jun 23 13:04:19 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:20 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.info" returned: 0 in 0.759s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:20 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.info is being set with open permissions: ugo+rw Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:20 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.info Jun 23 13:04:20 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:20 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff" returned: 0 in 0.730s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff" released by "delete_volume" :: held 1.762s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created reservations ['edc9df91-f248-4059-8a92-56fe5afe4648', 'dca3fc4c-dda4-4fb4-98fb-89fc5fe8841c', '43eebf3c-2ab5-4dc7-8370-011c38ce9740', '68e547c3-03da-4679-9015-a089409b2fec'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:20 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:20 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:21 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.info" returned: 0 in 0.877s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.245s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.205s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0758cd-0ead-4a20-9e50-6aaae8b8829e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2b460403e804d59b90692059a9684df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:00Z,use_quota=True,user_id='24507fd9b6c54a78b47f57f611d2542d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(eea9a7d5-827d-41b8-af1f-f2b6db7f88d3),volume_type_id=eea9a7d5-827d-41b8-af1f-f2b6db7f88d3)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Creating volume ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:21 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:21 devstack sudo[114487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e 1073741824 Jun 23 13:04:21 devstack sudo[114487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:21 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2b090fce-6200-4fad-ae65-a5ebbfa79c4c tempest-VolumeDependencyTests-632277257 None] Create snapshot completed successfully Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-quobyte-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9c9bb9-58df-4963-b84f-38283d1b9c8b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:21 devstack sudo[114489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 Jun 23 13:04:21 devstack sudo[114489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:21 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.911s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:21 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Deleted volume successfully. Jun 23 13:04:21 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2e54415b-405c-4068-a15d-f5e69cbfcbd0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-fea9b9e0-3dbf-40dc-92fe-e4abf440e5ff-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:22 devstack sudo[114487]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e 1073741824" returned: 0 in 1.185s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:22 devstack sudo[114499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:22 devstack sudo[114499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:22 devstack sudo[114501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e Jun 23 13:04:22 devstack sudo[114501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:22 devstack sudo[114489]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5" returned: 0 in 1.037s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:22 devstack sudo[114503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5 Jun 23 13:04:22 devstack sudo[114503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Flow 'volume_create_manager' (a93b7c0b-70e4-4ea2-80d2-0077833934de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6787ee45-e39d-4a12-b553-1581f2e427d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6787ee45-e39d-4a12-b553-1581f2e427d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1313783590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a318f2-d8da-433c-b4e0-20e2e8280a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2af126a762454a0e8502265ecb2537ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4ac105e6-4e93-4bc1-b812-54a77a5e7871,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:23Z,use_quota=True,user_id='b0dfdeacfbe94491ba357bb62a1b8adf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e859a95d-c260-42fd-ad59-8c77ae065e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e859a95d-c260-42fd-ad59-8c77ae065e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7286c638-336d-404a-b2be-4d51f7b19626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7286c638-336d-404a-b2be-4d51f7b19626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93a318f2-d8da-433c-b4e0-20e2e8280a4e', 'volume_name': 'volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e', 'volume_size': 1, 'snapshot_id': '4ac105e6-4e93-4bc1-b812-54a77a5e7871'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449d4a52-4546-402e-98f3-20b67efa1902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449d4a52-4546-402e-98f3-20b67efa1902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0da58f-da99-4ba0-ab84-a4de937d8cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Volume 93a318f2-d8da-433c-b4e0-20e2e8280a4e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e', 'volume_size': 1, 'snapshot_id': '4ac105e6-4e93-4bc1-b812-54a77a5e7871'} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:23 devstack sudo[114499]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.052s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:04:23 devstack sudo[114501]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" returned: 0 in 1.004s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] <== create_volume: return (2286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.290s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:23 devstack sudo[114503]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.246s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-quobyte-4ac105e6-4e93-4bc1-b812-54a77a5e7871-93a318f2-d8da-433c-b4e0-20e2e8280a4e" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5" returned: 0 in 0.966s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5" released by "delete_volume" :: held 2.073s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-4ac105e6-4e93-4bc1-b812-54a77a5e7871-93a318f2-d8da-433c-b4e0-20e2e8280a4e" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Creating volume 93a318f2-d8da-433c-b4e0-20e2e8280a4e from snapshot 4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-quobyte-93a318f2-d8da-433c-b4e0-20e2e8280a4e" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Attempting download of f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'metadata': {}}])) to volume ba0758cd-0ead-4a20-9e50-6aaae8b8829e. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-93a318f2-d8da-433c-b4e0-20e2e8280a4e" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] snapshot: 4ac105e6-4e93-4bc1-b812-54a77a5e7871, volume: 93a318f2-d8da-433c-b4e0-20e2e8280a4e, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb1e409-652e-4ed6-aecb-0654021a02c4]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_1u2qfrn1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[07461ab2-76b3-41cb-8d2f-c6610787b3d7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created reservations ['f18e2f15-1339-4f39-ad96-1bf3e115dba2', 'e33a9441-761b-4bd3-9a18-1f03c1ea74fd', '324d3ccb-eff5-4ed0-b1a0-439a852cda66', 'e8b084a5-02e3-427b-b08e-8bc9fb552ea6'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:23 devstack sudo[114509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_1u2qfrn1 Jun 23 13:04:23 devstack sudo[114509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:23 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 Jun 23 13:04:23 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (2cdf686c-b3c8-497f-9d7a-4ffe5d59c651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cdf554-c394-437d-9c6e-10c8a505b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:23 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:23 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16cdf554-c394-437d-9c6e-10c8a505b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-909413821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7f3e14-a96c-4353-b63f-0d7711784ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:24Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd5beb9-1906-4c6e-a680-9ba48b8f335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd5beb9-1906-4c6e-a680-9ba48b8f335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da08d0e6-3755-4c90-872d-8824cda7007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da08d0e6-3755-4c90-872d-8824cda7007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7f3e14-a96c-4353-b63f-0d7711784ed7', 'volume_name': 'volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5142d0e0-61a7-42c5-8dff-31bc682e939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5142d0e0-61a7-42c5-8dff-31bc682e939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37317078-1755-4db9-b61f-2911a239de05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:23 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume 6d7f3e14-a96c-4353-b63f-0d7711784ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7', 'volume_size': 1} Jun 23 13:04:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:24 devstack sudo[114509]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_1u2qfrn1" returned: 0 in 0.816s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_1u2qfrn1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:24 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871" returned: 0 in 0.853s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2305fe-3114-4d9b-abc4-a1f52eca4787]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:24 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.749s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:24 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Deleted volume successfully. Jun 23 13:04:24 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_1u2qfrn1 Jun 23 13:04:24 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-d7a5cdfe-a648-417d-9018-7b6a1c973a8d tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-234ad557-70d9-4c5c-bd4b-b24d5a2b06c5-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-36ba8122-5b75-4c8c-a551-d7f0657bf098-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:24 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-36ba8122-5b75-4c8c-a551-d7f0657bf098-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:24 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-quobyte-36ba8122-5b75-4c8c-a551-d7f0657bf098" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-36ba8122-5b75-4c8c-a551-d7f0657bf098" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf301a-9f8c-44c8-8935-66bf654cdf9b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:24 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:24 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 Jun 23 13:04:24 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:25 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_1u2qfrn1" returned: 1 in 0.792s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_1u2qfrn1' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15addda-adc3-49d8-bcd2-e23880f3cc40]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:25 devstack sudo[114529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD Jun 23 13:04:25 devstack sudo[114529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:25 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" returned: 0 in 0.910s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:25 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e Jun 23 13:04:25 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:25 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098" returned: 0 in 0.848s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:25 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098 Jun 23 13:04:25 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:25 devstack sudo[114529]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:25 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:26 devstack sudo[114543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD Jun 23 13:04:26 devstack sudo[114543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:26 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-36ba8122-5b75-4c8c-a551-d7f0657bf098" returned: 0 in 0.734s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-36ba8122-5b75-4c8c-a551-d7f0657bf098" released by "delete_volume" :: held 1.657s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created reservations ['ebe057cb-cfe5-4394-a80a-d25f01d336b7', '5bc15278-098a-4391-b4a2-ff01f19712a8', 'a86a3c81-ce4f-4199-a8a4-0634a0c76223', 'b7b6aa79-4d4c-429e-9e26-472e196643e5'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:26 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:26 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-8ad472f9-3a66-4c72-9003-fdd1b0aa8113-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-8ad472f9-3a66-4c72-9003-fdd1b0aa8113-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-quobyte-8ad472f9-3a66-4c72-9003-fdd1b0aa8113" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-8ad472f9-3a66-4c72-9003-fdd1b0aa8113" acquired by "delete_volume" :: waited 0.042s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[57202fe7-69c7-40b3-87d3-eecf0e9a0901]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:27 devstack sudo[114543]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD" returned: 1 in 1.595s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 was raw, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 13:04:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:27 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 Jun 23 13:04:27 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:27 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e Jun 23 13:04:27 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:29 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 2.328s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:29 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:29 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Deleted volume successfully. Jun 23 13:04:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0873339c-ec84-470b-9059-3b33df5d566e tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-36ba8122-5b75-4c8c-a551-d7f0657bf098-delete_volume" released by "delete_volume" :: held 4.467s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:29 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" returned: 0 in 1.979s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:29 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f74ed442-4a75-4cdc-85e8-d809f5e7ebf0_6k606vlidevstack@QuobyteHD, size 0.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:04:29 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 13:04:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:29 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e 1G Jun 23 13:04:29 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:30 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113" returned: 0 in 2.862s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:30 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113 Jun 23 13:04:30 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:31 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e 1G" returned: 0 in 1.635s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[507c2bae-4072-48a7-b893-5201e48a910d]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:31 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e Jun 23 13:04:31 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:31 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e" returned: 0 in 6.065s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:31 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-8ad472f9-3a66-4c72-9003-fdd1b0aa8113" returned: 0 in 1.259s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a4d65-59b7-4d5e-8dec-902b5eb81f2a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-8ad472f9-3a66-4c72-9003-fdd1b0aa8113" released by "delete_volume" :: held 4.260s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created reservations ['1329df22-60b8-4603-867a-c117b1fcd017', '219acda5-6b73-491a-bcb6-c5daaccecffc', 'add9044c-b554-44e2-9ae4-05b032cd377a', '9cbce6e1-13f2-4f85-bc5f-2e41cdaf066c'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:31 devstack sudo[114590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 Jun 23 13:04:31 devstack sudo[114590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:31 devstack sudo[114592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:31 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-da2893c1-1a83-4762-be99-7b7dcdb0bd40-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:31 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-da2893c1-1a83-4762-be99-7b7dcdb0bd40-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "cinder-quobyte-da2893c1-1a83-4762-be99-7b7dcdb0bd40" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-da2893c1-1a83-4762-be99-7b7dcdb0bd40" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8916d6d-cdc6-44d7-9a8d-67801d00859f]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:32 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" returned: 0 in 0.893s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:32 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 Jun 23 13:04:32 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:32 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e Jun 23 13:04:32 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:32 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.731s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Deleted volume successfully. Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-84bb333b-b2a1-4b03-864b-cdb13edb00b0 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-8ad472f9-3a66-4c72-9003-fdd1b0aa8113-delete_volume" released by "delete_volume" :: held 5.299s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:32 devstack sudo[114590]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" returned: 0 in 1.100s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:04:32 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Converted 1024.00 MB image at 168.81 MB/s Jun 23 13:04:32 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e is being set with open permissions: ugo+rw Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:32 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e Jun 23 13:04:32 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:32 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40" returned: 0 in 0.793s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:32 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40 Jun 23 13:04:32 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:32 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" returned: 1 in 0.822s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Downloaded image f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 ((None, [{'url': 'file:///opt/stack/data/glance/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'metadata': {}}])) to volume ba0758cd-0ead-4a20-9e50-6aaae8b8829e successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Temporary image f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 for user 24507fd9b6c54a78b47f57f611d2542d is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 13:04:32 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Marking volume ba0758cd-0ead-4a20-9e50-6aaae8b8829e as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Copying metadata from image f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 to ba0758cd-0ead-4a20-9e50-6aaae8b8829e. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Creating volume glance metadata for volume ba0758cd-0ead-4a20-9e50-6aaae8b8829e backed by image f74ed442-4a75-4cdc-85e8-d809f5e7ebf0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '579455b38f7cbd7eeb18806756989578', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66420ba9-a4e1-400a-9543-65d8c4e2871f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e', 'volume_size': 1, 'image_id': 'f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '579455b38f7cbd7eeb18806756989578', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e2b460403e804d59b90692059a9684df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2ab3c30d8289564ada57ce3e6db9a2a7f018a81e5e803f504de3f817bec051c56e6eb1ac62918b8ae30b655d32bb8af14e75e600aeb7861ef6143fded4e4068a', 'id': 'f74ed442-4a75-4cdc-85e8-d809f5e7ebf0', 'created_at': datetime.datetime(2026, 6, 23, 11, 3, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 3, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f74ed442-4a75-4cdc-85e8-d809f5e7ebf0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d598ae-3866-41fc-970b-4ee65c01da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:33 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Volume volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e (ba0758cd-0ead-4a20-9e50-6aaae8b8829e): created successfully Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7d598ae-3866-41fc-970b-4ee65c01da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Flow 'volume_create_manager' (6abb8a98-0b0f-46a1-a65c-3aa0b416d6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:33 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e1e8234c-8b70-4cde-b32f-dbad0ee3bacf tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Created volume successfully. Jun 23 13:04:33 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e" returned: 0 in 0.717s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-93a318f2-d8da-433c-b4e0-20e2e8280a4e" released by "_copy_volume_from_snapshot" :: held 9.794s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-4ac105e6-4e93-4bc1-b812-54a77a5e7871-93a318f2-d8da-433c-b4e0-20e2e8280a4e" released by "_create_volume_from_snapshot" :: held 9.854s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.898s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.487s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-909413821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7f3e14-a96c-4353-b63f-0d7711784ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:24Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Creating volume 6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:33 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:33 devstack sudo[114615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 1073741824 Jun 23 13:04:33 devstack sudo[114615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0da58f-da99-4ba0-ab84-a4de937d8cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e', 'volume_size': 1, 'snapshot_id': '4ac105e6-4e93-4bc1-b812-54a77a5e7871'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b501f198-7763-4596-ad37-eb0d6ffa25f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:33 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Volume volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e (93a318f2-d8da-433c-b4e0-20e2e8280a4e): created successfully Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b501f198-7763-4596-ad37-eb0d6ffa25f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Flow 'volume_create_manager' (a93b7c0b-70e4-4ea2-80d2-0077833934de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:33 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0a432e36-0a50-471b-bf7d-4b43fce6ab1b tempest-VolumeDependencyTests-632277257 None] Created volume successfully. Jun 23 13:04:33 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-da2893c1-1a83-4762-be99-7b7dcdb0bd40" returned: 0 in 0.685s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-quobyte-da2893c1-1a83-4762-be99-7b7dcdb0bd40" released by "delete_volume" :: held 1.522s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Created reservations ['c335f8ba-2ac5-43a0-bf03-5e1faefc95a2', '3b7de71b-2d4c-434b-98fd-7cf5fca99d80', '362ea0b6-f23e-464c-bbb8-27bb585578ed', '187f4c95-c0a4-41ff-a329-3eb53a21494c'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:33 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:33 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-4ac105e6-4e93-4bc1-b812-54a77a5e7871-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-4ac105e6-4e93-4bc1-b812-54a77a5e7871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-quobyte-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-quobyte-4ac105e6-4e93-4bc1-b812-54a77a5e7871" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-4ac105e6-4e93-4bc1-b812-54a77a5e7871" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Deleting offline snapshot 4ac105e6-4e93-4bc1-b812-54a77a5e7871 of volume 361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] snapshot_file for this snap is: volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc2c1e2-25ba-4288-9286-100b809ea9f7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Acquiring lock "cinder-ba0758cd-0ead-4a20-9e50-6aaae8b8829e-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:34 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 Jun 23 13:04:34 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "cinder-ba0758cd-0ead-4a20-9e50-6aaae8b8829e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Acquiring lock "cinder-quobyte-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "cinder-quobyte-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:34 devstack sudo[114615]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 1073741824" returned: 0 in 1.053s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[574b170f-838b-4d78-9a8b-9c57994658ab]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:34 devstack sudo[114627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 Jun 23 13:04:34 devstack sudo[114627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:34 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.853s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:34 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Deleted volume successfully. Jun 23 13:04:34 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e Jun 23 13:04:34 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-56e19243-cc1a-4c11-a38b-8daaddec0ec8 tempest-CreateVolumesFromSourceVolumeTest-1639685206 None] Lock "cinder-da2893c1-1a83-4762-be99-7b7dcdb0bd40-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:34 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3ded59-19b8-4e1d-a740-790b17bf4195]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:35 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 Jun 23 13:04:35 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:35 devstack sudo[114627]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7" returned: 0 in 0.850s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:35 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" returned: 0 in 0.917s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37317078-1755-4db9-b61f-2911a239de05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205b9162-b79d-4452-96a9-dca57cf8b3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:35 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 (6d7f3e14-a96c-4353-b63f-0d7711784ed7): created successfully Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205b9162-b79d-4452-96a9-dca57cf8b3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (2cdf686c-b3c8-497f-9d7a-4ffe5d59c651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a6d350c9-3ee5-467b-99d0-b70aefbf3b43 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created volume successfully. Jun 23 13:04:35 devstack sudo[114639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e Jun 23 13:04:35 devstack sudo[114639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:35 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" returned: 0 in 0.939s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:35 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 Jun 23 13:04:35 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:36 devstack sudo[114639]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" returned: 1 in 0.864s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:36 devstack sudo[114649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e Jun 23 13:04:36 devstack sudo[114649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Creating offline snapshot 2fdf7233-e55d-4502-b2ab-595c3e9dddde of volume 6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa757fa2-89bd-44c7-865c-536f798181f1]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:36 devstack sudo[114651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 Jun 23 13:04:36 devstack sudo[114651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:36 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871" returned: 0 in 0.909s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:36 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871 Jun 23 13:04:36 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:37 devstack sudo[114649]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" returned: 0 in 0.835s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "cinder-quobyte-ba0758cd-0ead-4a20-9e50-6aaae8b8829e" released by "delete_volume" :: held 2.707s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Created reservations ['aa2e64d3-223f-48ac-a30e-42556fbaee17', 'b17f8c57-3b45-4366-a84d-0727b19f5c5a', 'eb2138ab-3dda-4bcd-85a5-57a6a69bf6dc', '5ca72a94-4576-41f1-b4aa-3e6991cb9087'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:37 devstack sudo[114651]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7" returned: 0 in 0.956s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:37 devstack sudo[114662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:37 devstack sudo[114662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:37 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde 1G Jun 23 13:04:37 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:37 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1.4ac105e6-4e93-4bc1-b812-54a77a5e7871" returned: 0 in 0.816s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-4ac105e6-4e93-4bc1-b812-54a77a5e7871" released by "_delete_snapshot" :: held 3.734s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" released by "delete_snapshot" :: held 3.770s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Created reservations ['968a1e4b-ab03-4c99-97a5-b7d9be3b8540', 'dcdbf031-5360-4d82-8394-bbfca7c15c49', 'bb8c689a-f7a6-4c4e-be60-7775b7d81cfc', '5e4a1175-ae5d-47d1-b3b1-2368c14508e2'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:37 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Delete snapshot completed successfully. Jun 23 13:04:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-453d7537-c076-4f0b-9d10-e8c173ffea0b tempest-VolumeDependencyTests-632277257 None] Lock "cinder-4ac105e6-4e93-4bc1-b812-54a77a5e7871-delete_snapshot" released by "delete_snapshot" :: held 3.985s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:38 devstack sudo[114662]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.074s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:38 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Deleted volume successfully. Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4af8ceec-6eda-4878-80e9-4a3849d7a090 tempest-VolumeAndVolumeTypeFromImageTest-1578527846 None] Lock "cinder-ba0758cd-0ead-4a20-9e50-6aaae8b8829e-delete_volume" released by "delete_volume" :: held 4.124s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Lock "cinder-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-quobyte-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" acquired by "delete_volume" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:38 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde 1G" returned: 0 in 1.266s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e2257d-463c-446b-b8c2-95204d5bbb1d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:38 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:38 devstack sudo[114673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde Jun 23 13:04:38 devstack sudo[114673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:38 devstack sudo[114675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 Jun 23 13:04:38 devstack sudo[114675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:39 devstack sudo[114673]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde" returned: 0 in 1.008s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:39 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde is being set with open permissions: ugo+rw Jun 23 13:04:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:39 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde Jun 23 13:04:39 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:39 devstack sudo[114675]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" returned: 0 in 1.202s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:39 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:39 devstack sudo[114686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1 Jun 23 13:04:39 devstack sudo[114686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:40 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde" returned: 0 in 0.952s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:40 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.info Jun 23 13:04:40 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:40 devstack sudo[114686]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:40 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" returned: 0 in 1.204s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1" released by "delete_volume" :: held 2.514s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Created reservations ['c6e77d66-276a-4a29-aa5f-41bd571a7669', '773cf0b6-9576-475a-975e-5cd246090a4c', '96388a2c-8b34-4752-b446-152b85c6d500', '9e1ea51c-1eb2-42ac-88b1-0d0a41e8b94c'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:41 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:41 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:41 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.info" returned: 0 in 1.077s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:41 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.info is being set with open permissions: ugo+rw Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:41 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.info Jun 23 13:04:41 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-93a318f2-d8da-433c-b4e0-20e2e8280a4e-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:41 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Lock "cinder-93a318f2-d8da-433c-b4e0-20e2e8280a4e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Acquiring lock "cinder-quobyte-93a318f2-d8da-433c-b4e0-20e2e8280a4e" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-93a318f2-d8da-433c-b4e0-20e2e8280a4e" acquired by "delete_volume" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[da181fa6-6003-41cb-96c1-a5959b905c35]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:42 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.077s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Deleted volume successfully. Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-4ce30a7a-bbff-4f93-a9e2-147a883e075a tempest-VolumeDependencyTests-632277257 None] Lock "cinder-361eb59e-4ea0-4368-9be1-d7a8e7dfa6e1-delete_volume" released by "delete_volume" :: held 3.906s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:42 devstack sudo[114700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e Jun 23 13:04:42 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:42 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.info" returned: 0 in 1.086s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:42 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.482s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:42 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-95d1a2c6-1dde-4e07-a6d1-2fc03dfe680f tempest-CreateVolumesFromSnapshotTest-1858124751 None] Create snapshot completed successfully Jun 23 13:04:43 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e" returned: 0 in 1.064s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:43 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:43 devstack sudo[114706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e Jun 23 13:04:43 devstack sudo[114706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:44 devstack sudo[114706]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-93a318f2-d8da-433c-b4e0-20e2e8280a4e" returned: 0 in 1.038s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Lock "cinder-quobyte-93a318f2-d8da-433c-b4e0-20e2e8280a4e" released by "delete_volume" :: held 2.213s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Created reservations ['88559600-a9bd-4b81-aae8-ef57b8366a25', '9c18d040-fca6-415f-b8f8-1bfacbf0b99c', 'd3921d9f-a146-4773-b649-6f66447a896a', 'ae70fe64-d279-4f33-ab42-c28cc1491455'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:44 devstack sudo[114709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:44 devstack sudo[114709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (62ecfbc0-8602-4afc-9b44-d5b7c4e7a549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5f344a-f3ee-4c65-89a5-795400fd3f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e5f344a-f3ee-4c65-89a5-795400fd3f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064724576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074c10db-cf47-4bbf-821e-6e4473b14594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:45Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3056dd67-c224-4fd2-8385-2f55687948c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3056dd67-c224-4fd2-8385-2f55687948c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14543802-34d2-40cf-baf0-9ccec54d87da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14543802-34d2-40cf-baf0-9ccec54d87da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074c10db-cf47-4bbf-821e-6e4473b14594', 'volume_name': 'volume-074c10db-cf47-4bbf-821e-6e4473b14594', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efe564f-c44f-4e2e-b2d4-6055d298d306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5efe564f-c44f-4e2e-b2d4-6055d298d306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623dcef3-d51a-406e-ac9a-a52b9beab109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:44 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume 074c10db-cf47-4bbf-821e-6e4473b14594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074c10db-cf47-4bbf-821e-6e4473b14594', 'volume_size': 1} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064724576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074c10db-cf47-4bbf-821e-6e4473b14594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:45Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Creating volume 074c10db-cf47-4bbf-821e-6e4473b14594 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:44 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:44 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:44 devstack sudo[114711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 1073741824 Jun 23 13:04:44 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (343b1023-a38f-43c9-b385-23a1827023ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc94f754-1103-4425-a474-7573e3945020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc94f754-1103-4425-a474-7573e3945020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-99622977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ff4311-c1f8-40a3-acf3-a84d39547cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:45Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f9fcbc-12f0-4320-9ae8-d5f19015dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25f9fcbc-12f0-4320-9ae8-d5f19015dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e12331d-1dc6-4856-835f-05eaeb6e2ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e12331d-1dc6-4856-835f-05eaeb6e2ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ff4311-c1f8-40a3-acf3-a84d39547cbf', 'volume_name': 'volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f9aa74-7780-4879-8b13-d819d1d4a1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f9aa74-7780-4879-8b13-d819d1d4a1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68c044-09ed-4b1f-94fe-3695e529069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:45 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume 26ff4311-c1f8-40a3-acf3-a84d39547cbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf', 'volume_size': 1} Jun 23 13:04:45 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:46 devstack sudo[114709]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.605s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:04:46 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Deleted volume successfully. Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=155,cinder:SELECT=126,cinder:DELETE=15,cinder:INSERT=43 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (eec7ba2f-7d52-4fb6-afd2-2ad94b96af42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dc8101-0c02-497c-989e-0babce148464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b96c4510-e9f1-49a7-8d5e-91f558321648 tempest-VolumeDependencyTests-632277257 None] Lock "cinder-93a318f2-d8da-433c-b4e0-20e2e8280a4e-delete_volume" released by "delete_volume" :: held 4.388s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dc8101-0c02-497c-989e-0babce148464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551748142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d172429a-12c8-4cf0-9968-a7ae58608cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:46Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893a0550-2761-4de1-9d8e-4916b555da03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893a0550-2761-4de1-9d8e-4916b555da03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4a847f-61e5-4a83-b9ae-5a3020aa9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4a847f-61e5-4a83-b9ae-5a3020aa9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd172429a-12c8-4cf0-9968-a7ae58608cdd', 'volume_name': 'volume-d172429a-12c8-4cf0-9968-a7ae58608cdd', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20708f3a-bef3-49d9-9e89-0a6cd3a02558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20708f3a-bef3-49d9-9e89-0a6cd3a02558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eb0845-4433-440c-aa53-6e3ba8f6bb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume d172429a-12c8-4cf0-9968-a7ae58608cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d172429a-12c8-4cf0-9968-a7ae58608cdd', 'volume_size': 1} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:46 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 1073741824" returned: 0 in 1.917s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:46 devstack sudo[114718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 Jun 23 13:04:46 devstack sudo[114718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (4344a636-46b5-4415-89c2-7bd7a8b47dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f13343-5c4b-41f2-a592-a9ab2a269187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67f13343-5c4b-41f2-a592-a9ab2a269187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038394334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b7d04d-0acd-4dee-b3b2-97246b6da056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:47Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06822724-7e64-4135-9a08-1dd125c7248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06822724-7e64-4135-9a08-1dd125c7248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb7be2e-3d77-471b-8570-420a485a77f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb7be2e-3d77-471b-8570-420a485a77f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b7d04d-0acd-4dee-b3b2-97246b6da056', 'volume_name': 'volume-67b7d04d-0acd-4dee-b3b2-97246b6da056', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794aa2fa-4fcd-4888-8add-1d3365ae006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (794aa2fa-4fcd-4888-8add-1d3365ae006d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed958a76-5832-48c0-9dd8-87de567f7ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:46 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume 67b7d04d-0acd-4dee-b3b2-97246b6da056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b7d04d-0acd-4dee-b3b2-97246b6da056', 'volume_size': 1} Jun 23 13:04:46 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (44ae2077-c204-474e-af34-740f4ae2e764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea971034-2c3b-4aa8-88fa-519257f1546d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea971034-2c3b-4aa8-88fa-519257f1546d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877272569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3613114-06b0-48a7-b2a0-c4424557b245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:47Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbb2bb6-d5fd-4c13-9e8e-c4c50a72ba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbb2bb6-d5fd-4c13-9e8e-c4c50a72ba35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8af5853-b1fd-4184-a200-1a85227f8fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8af5853-b1fd-4184-a200-1a85227f8fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3613114-06b0-48a7-b2a0-c4424557b245', 'volume_name': 'volume-f3613114-06b0-48a7-b2a0-c4424557b245', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfd12fd-9718-43bc-a37b-8e94911ba9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bfd12fd-9718-43bc-a37b-8e94911ba9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ba5752-2e0d-4a5b-a095-66c4e43d8082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:47 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume f3613114-06b0-48a7-b2a0-c4424557b245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3613114-06b0-48a7-b2a0-c4424557b245', 'volume_size': 1} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594" returned: 0 in 1.101s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] <== create_volume: return (3124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.127s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:47 devstack sudo[114718]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.503s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-99622977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ff4311-c1f8-40a3-acf3-a84d39547cbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:45Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Creating volume 26ff4311-c1f8-40a3-acf3-a84d39547cbf {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:47 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:47 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:48 devstack sudo[114722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf 1073741824 Jun 23 13:04:48 devstack sudo[114722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (623dcef3-d51a-406e-ac9a-a52b9beab109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074c10db-cf47-4bbf-821e-6e4473b14594', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61a3f0a-a58f-4096-a412-d2606cb61417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:48 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume volume-074c10db-cf47-4bbf-821e-6e4473b14594 (074c10db-cf47-4bbf-821e-6e4473b14594): created successfully Jun 23 13:04:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61a3f0a-a58f-4096-a412-d2606cb61417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:48 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (62ecfbc0-8602-4afc-9b44-d5b7c4e7a549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:48 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-71ad78ad-7b7f-4119-b17e-db2e2a5b8822 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created volume successfully. Jun 23 13:04:49 devstack sudo[114722]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf 1073741824" returned: 0 in 1.483s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:49 devstack sudo[114728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf Jun 23 13:04:49 devstack sudo[114728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Flow 'volume_create_manager' (289d1a59-5815-4a0f-a99f-8cdfc5eefe7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd56cb80-22d2-4d5c-b798-fc4ec948e9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd56cb80-22d2-4d5c-b798-fc4ec948e9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fdea7f-571b-4817-a5c1-f121bf67a443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c9809b508447ad8f8a6a24808f6fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:50Z,use_quota=True,user_id='900b83ee28b84a02b02d593d7f4443df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47636fd6-5807-4b2c-915d-8115ec516d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47636fd6-5807-4b2c-915d-8115ec516d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c67b35a-f954-4517-8cbb-c38b5527e545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:49 devstack cinder-volume[93659]: DEBUG cinder.image.glance [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Creating Keystone auth plugin from conf {{(pid=93659) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 13:04:50 devstack sudo[114728]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf" returned: 0 in 0.778s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] <== create_volume: return (2325ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c67b35a-f954-4517-8cbb-c38b5527e545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45fdea7f-571b-4817-a5c1-f121bf67a443', 'volume_name': 'volume-45fdea7f-571b-4817-a5c1-f121bf67a443', 'volume_size': 1, 'image_id': '072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c501e8b7680d2b8198b489ee1aefa41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd1c9809b508447ad8f8a6a24808f6fae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '90423bdc0ef4d47b67235bb0ea3744d18ff6888cfa909c6e496f34bc4b675fe1003963ee53532b7fc516e7b4818bc0706c1558c8ad9c41ec0c2c1c886f53a935', 'id': '072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'created_at': datetime.datetime(2026, 6, 23, 11, 4, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 4, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e/file', 'properties': {}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa1747d-baa7-47ba-b449-4d35d515e5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa1747d-baa7-47ba-b449-4d35d515e5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656868ae-d7f2-4d4f-9fc6-04b6f34cfbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Volume 45fdea7f-571b-4817-a5c1-f121bf67a443: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45fdea7f-571b-4817-a5c1-f121bf67a443', 'volume_size': 1, 'image_id': '072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c501e8b7680d2b8198b489ee1aefa41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd1c9809b508447ad8f8a6a24808f6fae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '90423bdc0ef4d47b67235bb0ea3744d18ff6888cfa909c6e496f34bc4b675fe1003963ee53532b7fc516e7b4818bc0706c1558c8ad9c41ec0c2c1c886f53a935', 'id': '072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'created_at': datetime.datetime(2026, 6, 23, 11, 4, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 4, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e/file', 'properties': {}}, 'image_service': } Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Trying to clone 45fdea7f-571b-4817-a5c1-f121bf67a443 from image 072ecb03-14ef-40d5-b5aa-f22be4f2371e at location (None, [{'url': 'file:///opt/stack/data/glance/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'metadata': {}}]). {{(pid=93659) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.787s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-551748142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d172429a-12c8-4cf0-9968-a7ae58608cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:46Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Creating volume d172429a-12c8-4cf0-9968-a7ae58608cdd {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:50 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68c044-09ed-4b1f-94fe-3695e529069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd 1073741824 Jun 23 13:04:50 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a49047-7ec7-4b12-b2d5-632cf76274a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf (26ff4311-c1f8-40a3-acf3-a84d39547cbf): created successfully Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a49047-7ec7-4b12-b2d5-632cf76274a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (343b1023-a38f-43c9-b385-23a1827023ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:50 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e9ae8c5a-66a1-4012-a219-bb5fb5f73554 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created volume successfully. Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 13:04:50 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Image download 0.00 MB at 0.00 MB/s Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4d1a56-679b-4c14-aeb7-e0ad43c7dc2d]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:50 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD Jun 23 13:04:50 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Flow 'volume_create_manager' (99a23487-af7c-4d27-b755-6f1da27fb732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e4139a-b655-4b97-91d5-e37d76f4cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e4139a-b655-4b97-91d5-e37d76f4cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935ea3ea-0d9c-44ea-a31d-4ad5781a0f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826f7b67a8c7471a88ea5cd7f98ff0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:51Z,use_quota=True,user_id='4efe5887fb254665a22b64bfe5d40aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dd8f2d-bc38-49c7-b099-0c8590495adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dd8f2d-bc38-49c7-b099-0c8590495adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a28696f-ef76-4c81-9d98-7702f1b6eb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a28696f-ef76-4c81-9d98-7702f1b6eb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '935ea3ea-0d9c-44ea-a31d-4ad5781a0f15', 'volume_name': 'volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdf60e7-5552-4905-a714-b05e9f14aa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fdf60e7-5552-4905-a714-b05e9f14aa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de8f9eb-465a-42d4-9804-1e57c1ea6e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:50 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Volume 935ea3ea-0d9c-44ea-a31d-4ad5781a0f15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15', 'volume_size': 1} Jun 23 13:04:50 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:51 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:51 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd 1073741824" returned: 0 in 1.209s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD" returned: 0 in 0.926s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:51 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:51 devstack sudo[114742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd Jun 23 13:04:51 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:51 devstack sudo[114741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD Jun 23 13:04:51 devstack sudo[114741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:52 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd" returned: 0 in 0.752s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.046s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.376s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038394334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b7d04d-0acd-4dee-b3b2-97246b6da056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:47Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Creating volume 67b7d04d-0acd-4dee-b3b2-97246b6da056 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:52 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:52 devstack sudo[114750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 1073741824 Jun 23 13:04:52 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eb0845-4433-440c-aa53-6e3ba8f6bb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d172429a-12c8-4cf0-9968-a7ae58608cdd', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0785b5-d151-44a7-a343-b90fa08d65ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:52 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume volume-d172429a-12c8-4cf0-9968-a7ae58608cdd (d172429a-12c8-4cf0-9968-a7ae58608cdd): created successfully Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0785b5-d151-44a7-a343-b90fa08d65ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (eec7ba2f-7d52-4fb6-afd2-2ad94b96af42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:52 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-ed8de92e-75c6-4b6f-92e9-a9857ed1917a tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created volume successfully. Jun 23 13:04:52 devstack sudo[114741]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD" returned: 1 in 0.953s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Temporary image 072ecb03-14ef-40d5-b5aa-f22be4f2371e is fetched for user 900b83ee28b84a02b02d593d7f4443df. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd9ec00-3353-47da-a08f-4fc61ff341be]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:52 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:52 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD Jun 23 13:04:52 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:53 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 1073741824" returned: 0 in 1.195s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:53 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD" returned: 0 in 1.026s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:53 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:53 devstack sudo[114762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 Jun 23 13:04:53 devstack sudo[114762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:53 devstack sudo[114761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD Jun 23 13:04:53 devstack sudo[114761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:54 devstack sudo[114762]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056" returned: 0 in 0.742s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] <== create_volume: return (2024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.028s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.064s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1877272569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3613114-06b0-48a7-b2a0-c4424557b245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eaab59a19446aea0407c1eb6d324a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:47Z,use_quota=True,user_id='e8d4db773d724db8a8d731e370833651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Creating volume f3613114-06b0-48a7-b2a0-c4424557b245 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:54 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed958a76-5832-48c0-9dd8-87de567f7ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b7d04d-0acd-4dee-b3b2-97246b6da056', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:54 devstack sudo[114769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 1073741824 Jun 23 13:04:54 devstack sudo[114769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7751424-9700-4ad4-aaf5-103e8d3ac1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:54 devstack sudo[114761]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD" returned: 1 in 0.859s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:54 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 (67b7d04d-0acd-4dee-b3b2-97246b6da056): created successfully Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7751424-9700-4ad4-aaf5-103e8d3ac1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:54 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (4344a636-46b5-4415-89c2-7bd7a8b47dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:54 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b9b15da0-2f6e-469d-a4c0-11d8c6846f4e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created volume successfully. Jun 23 13:04:55 devstack sudo[114769]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 1073741824" returned: 0 in 1.064s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:55 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:SELECT=128,cinder:UPDATE=193,cinder:INSERT=47,cinder:DELETE=16 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:04:55 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:55 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 Jun 23 13:04:55 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:56 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245" returned: 0 in 0.727s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.308s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935ea3ea-0d9c-44ea-a31d-4ad5781a0f15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826f7b67a8c7471a88ea5cd7f98ff0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:51Z,use_quota=True,user_id='4efe5887fb254665a22b64bfe5d40aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Creating volume 935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:56 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ba5752-2e0d-4a5b-a095-66c4e43d8082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3613114-06b0-48a7-b2a0-c4424557b245', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:56 devstack sudo[114778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 1073741824 Jun 23 13:04:56 devstack sudo[114778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf6ac8a-3e6e-4d50-8f62-9b80d7ad06fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:56 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Volume volume-f3613114-06b0-48a7-b2a0-c4424557b245 (f3613114-06b0-48a7-b2a0-c4424557b245): created successfully Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf6ac8a-3e6e-4d50-8f62-9b80d7ad06fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:56 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Flow 'volume_create_manager' (44ae2077-c204-474e-af34-740f4ae2e764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:56 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-14ddb10a-938f-4c2f-a0e0-fa6661f68dcf tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created volume successfully. Jun 23 13:04:57 devstack sudo[114778]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 1073741824" returned: 0 in 0.940s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:57 devstack sudo[114784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 Jun 23 13:04:57 devstack sudo[114784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-f3613114-06b0-48a7-b2a0-c4424557b245-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-f3613114-06b0-48a7-b2a0-c4424557b245-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-f3613114-06b0-48a7-b2a0-c4424557b245" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-f3613114-06b0-48a7-b2a0-c4424557b245" acquired by "delete_volume" :: waited 0.020s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd042e22-68ce-47fd-909c-15a8fdfffe28]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:04:57 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:57 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 Jun 23 13:04:57 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:58 devstack sudo[114784]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15" returned: 0 in 0.779s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.542s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45fdea7f-571b-4817-a5c1-f121bf67a443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1c9809b508447ad8f8a6a24808f6fae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:50Z,use_quota=True,user_id='900b83ee28b84a02b02d593d7f4443df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Creating volume 45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:04:58 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de8f9eb-465a-42d4-9804-1e57c1ea6e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:58 devstack sudo[114790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 1073741824 Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327b7bae-ac57-418c-ba3d-8db2e250e3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:58 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:58 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Volume volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 (935ea3ea-0d9c-44ea-a31d-4ad5781a0f15): created successfully Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327b7bae-ac57-418c-ba3d-8db2e250e3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Flow 'volume_create_manager' (99a23487-af7c-4d27-b755-6f1da27fb732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:58 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-c5179984-3b1d-46a7-8fb1-74edbb1946a2 tempest-CinderUnicodeTest-315342380 None] Created volume successfully. Jun 23 13:04:58 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245" returned: 0 in 1.215s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:58 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:58 devstack sudo[114799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245 Jun 23 13:04:58 devstack sudo[114799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:04:59 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Flow 'volume_create_manager' (7ab5cf6d-d57d-44fa-a324-fb71cdff81ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59230b0a-75d9-4e8a-a573-e2f6595a9c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 1073741824" returned: 0 in 1.197s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59230b0a-75d9-4e8a-a573-e2f6595a9c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-410776889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826f7b67a8c7471a88ea5cd7f98ff0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:59Z,use_quota=True,user_id='4efe5887fb254665a22b64bfe5d40aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b96da5-cc42-4927-b964-c436333fa8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b96da5-cc42-4927-b964-c436333fa8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be49f5-3b91-444f-94bc-1b7bff12a375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be49f5-3b91-444f-94bc-1b7bff12a375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234', 'volume_name': 'volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53117e4-f8cb-496d-99ad-91c61f4d10fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53117e4-f8cb-496d-99ad-91c61f4d10fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13697ff-2ae1-433d-8953-c0e136394954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:04:59 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Volume bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234', 'volume_size': 1} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:04:59 devstack sudo[114802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 Jun 23 13:04:59 devstack sudo[114802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:04:59 devstack sudo[114799]: pam_unix(sudo:session): session closed for user root Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-f3613114-06b0-48a7-b2a0-c4424557b245" returned: 0 in 0.982s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-f3613114-06b0-48a7-b2a0-c4424557b245" released by "delete_volume" :: held 2.288s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:04:59 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created reservations ['563eb426-c2d7-4319-8406-528eafea8ede', 'ff02f4b0-bf25-42d0-8a89-1341a0a81470', '8d6572b6-e697-4f04-b6e4-4f44d2687400', '04792f37-6f9b-48d8-a6a3-0151efa8d9dc'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:00 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:00 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:00 devstack sudo[114802]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443" returned: 0 in 0.940s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.997s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:04:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-410776889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='826f7b67a8c7471a88ea5cd7f98ff0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:04:59Z,use_quota=True,user_id='4efe5887fb254665a22b64bfe5d40aef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Creating volume bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:05:00 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:00 devstack sudo[114808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 1073741824 Jun 23 13:05:00 devstack sudo[114808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Attempting download of 072ecb03-14ef-40d5-b5aa-f22be4f2371e ((None, [{'url': 'file:///opt/stack/data/glance/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'metadata': {}}])) to volume 45fdea7f-571b-4817-a5c1-f121bf67a443. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5aa772-5b29-4062-8dc5-a002c3e1dd62]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072ecb03-14ef-40d5-b5aa-f22be4f2371e_v7820g9w {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:00 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072ecb03-14ef-40d5-b5aa-f22be4f2371e_v7820g9w Jun 23 13:05:00 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:00 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.886s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:00 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Deleted volume successfully. Jun 23 13:05:00 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-0eb33727-57d2-4b60-8560-224ac8220c72 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-f3613114-06b0-48a7-b2a0-c4424557b245-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-67b7d04d-0acd-4dee-b3b2-97246b6da056-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-67b7d04d-0acd-4dee-b3b2-97246b6da056-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-67b7d04d-0acd-4dee-b3b2-97246b6da056" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-67b7d04d-0acd-4dee-b3b2-97246b6da056" acquired by "delete_volume" :: waited 0.039s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3164a7d-43d8-417e-986d-4b061ef51c40]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:01 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 Jun 23 13:05:01 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:01 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_072ecb03-14ef-40d5-b5aa-f22be4f2371e_v7820g9w" returned: 0 in 1.076s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072ecb03-14ef-40d5-b5aa-f22be4f2371e_v7820g9w {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:01 devstack sudo[114808]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 1073741824" returned: 0 in 1.380s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:01 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:01 devstack sudo[114824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072ecb03-14ef-40d5-b5aa-f22be4f2371e_v7820g9w Jun 23 13:05:01 devstack sudo[114824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:01 devstack sudo[114826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 Jun 23 13:05:01 devstack sudo[114826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:02 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056" returned: 0 in 1.039s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:02 devstack sudo[114831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056 Jun 23 13:05:02 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:02 devstack sudo[114824]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072ecb03-14ef-40d5-b5aa-f22be4f2371e_v7820g9w" returned: 1 in 1.142s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_072ecb03-14ef-40d5-b5aa-f22be4f2371e_v7820g9w' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0bef3d-3af2-4231-9f28-63a4c006f4a8]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:02 devstack sudo[114826]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" returned: 0 in 1.162s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] <== create_volume: return (2619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.626s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:02 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD Jun 23 13:05:02 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13697ff-2ae1-433d-8953-c0e136394954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:02 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8d361d-24b2-4a0b-854d-5a2abaecae3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:02 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Volume volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 (bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234): created successfully Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c8d361d-24b2-4a0b-854d-5a2abaecae3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Flow 'volume_create_manager' (7ab5cf6d-d57d-44fa-a324-fb71cdff81ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:05:03 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-e6dab916-f0d2-424c-abd9-f0926087e505 tempest-CinderUnicodeTest-315342380 None] Created volume successfully. Jun 23 13:05:03 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-67b7d04d-0acd-4dee-b3b2-97246b6da056" returned: 0 in 1.114s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-67b7d04d-0acd-4dee-b3b2-97246b6da056" released by "delete_volume" :: held 2.225s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created reservations ['daa1bfbb-80d2-4cee-8860-1fd3e1b07596', '24cbfb1e-aade-4caa-a813-50296a446e51', '63c65e54-9973-4030-be49-95c38c6b0104', 'd4ce772d-bf45-48f2-a04b-86eb8accafca'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:03 devstack sudo[114839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:03 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:03 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD" returned: 0 in 1.167s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Creating offline snapshot b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 of volume bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00df43c-ec18-471d-bea2-64a4d9a57972]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:03 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:04 devstack sudo[114843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD Jun 23 13:05:04 devstack sudo[114843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:04 devstack sudo[114844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 Jun 23 13:05:04 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-d172429a-12c8-4cf0-9968-a7ae58608cdd-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-d172429a-12c8-4cf0-9968-a7ae58608cdd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-d172429a-12c8-4cf0-9968-a7ae58608cdd" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:04 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-d172429a-12c8-4cf0-9968-a7ae58608cdd" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:04 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4a8600-40e6-4fb6-bcd5-d9a571676db7]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:04 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:05 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.528s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:05 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Deleted volume successfully. Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-8f7f7308-c1cd-4f17-8aba-6fd94f464894 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-67b7d04d-0acd-4dee-b3b2-97246b6da056-delete_volume" released by "delete_volume" :: held 4.113s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:05 devstack sudo[114848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd Jun 23 13:05:05 devstack sudo[114848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:05 devstack sudo[114843]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD" returned: 1 in 1.450s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] 072ecb03-14ef-40d5-b5aa-f22be4f2371e was raw, converting to raw {{(pid=93659) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:05 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" returned: 0 in 1.417s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:05 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:05 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 Jun 23 13:05:05 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:05 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 1G Jun 23 13:05:05 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:06 devstack sudo[114848]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd" returned: 0 in 1.171s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:06 devstack sudo[114869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd Jun 23 13:05:06 devstack sudo[114869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:06 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443" returned: 0 in 1.043s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_072ecb03-14ef-40d5-b5aa-f22be4f2371e_ethh4th1devstack@QuobyteHD, size 0.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:05:06 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:06 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 1G" returned: 0 in 1.020s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:06 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 1G Jun 23 13:05:06 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:06 devstack sudo[114874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 Jun 23 13:05:06 devstack sudo[114874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Flow 'volume_create_manager' (bd3be2ac-b1f3-471e-98be-7e03bd4389d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56724dc-ad30-4656-9524-1b9229ac58bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56724dc-ad30-4656-9524-1b9229ac58bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-602595344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdd34ac-e4fe-4b9d-8180-541aa0439958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa653b3923024f64a6089addfbaaf02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:05:07Z,use_quota=True,user_id='3ba63755155c412c960ae13c9eee5a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef68053-92a4-4c78-a76b-60d49a944408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef68053-92a4-4c78-a76b-60d49a944408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0db535e-f137-48a9-aec6-c4b024633e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0db535e-f137-48a9-aec6-c4b024633e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfdd34ac-e4fe-4b9d-8180-541aa0439958', 'volume_name': 'volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3469e61d-9c63-4140-8b5f-c24e11910d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3469e61d-9c63-4140-8b5f-c24e11910d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9b3b46-e3af-4819-a796-b55db22cb406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:06 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Volume bfdd34ac-e4fe-4b9d-8180-541aa0439958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958', 'volume_size': 1} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:06 devstack sudo[114869]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-d172429a-12c8-4cf0-9968-a7ae58608cdd" returned: 0 in 0.883s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:06 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-d172429a-12c8-4cf0-9968-a7ae58608cdd" released by "delete_volume" :: held 2.175s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created reservations ['9e61bf1a-708a-41a8-b40c-047d1146d3ab', '36b3d51b-a35f-462a-9660-9b3e698e9371', '923b2d30-47a2-492b-8866-a1fd8ae863e3', '4a92d6a1-a762-4a76-98ab-51163df88a69'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:07 devstack sudo[114884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:07 devstack sudo[114884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:07 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 1G" returned: 0 in 0.791s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:07 devstack sudo[114874]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" returned: 0 in 0.807s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:07 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 is being set with open permissions: ugo+rw Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b936d-8458-4361-865a-adb400bbe81e]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:07 devstack sudo[114886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 Jun 23 13:05:07 devstack sudo[114886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:07 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 Jun 23 13:05:07 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:07 devstack sudo[114884]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.679s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:07 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Deleted volume successfully. Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b0f1fefd-50e6-4dcd-a7b4-e076bcffe32b tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-d172429a-12c8-4cf0-9968-a7ae58608cdd-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:07 devstack sudo[114886]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" returned: 0 in 0.700s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:07 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:08 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.info Jun 23 13:05:08 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:08 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443" returned: 0 in 0.792s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-26ff4311-c1f8-40a3-acf3-a84d39547cbf-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-26ff4311-c1f8-40a3-acf3-a84d39547cbf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-26ff4311-c1f8-40a3-acf3-a84d39547cbf" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-26ff4311-c1f8-40a3-acf3-a84d39547cbf" acquired by "delete_volume" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[26df312d-ee80-4ee3-835e-48313d2acfce]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:08 devstack sudo[114897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 Jun 23 13:05:08 devstack sudo[114897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:08 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf Jun 23 13:05:08 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:08 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.info" returned: 0 in 0.720s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:08 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.info is being set with open permissions: ugo+rw Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:08 devstack sudo[114902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.info Jun 23 13:05:08 devstack sudo[114902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:08 devstack sudo[114897]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443" returned: 1 in 0.863s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Downloaded image 072ecb03-14ef-40d5-b5aa-f22be4f2371e ((None, [{'url': 'file:///opt/stack/data/glance/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'metadata': {}}])) to volume 45fdea7f-571b-4817-a5c1-f121bf67a443 successfully. {{(pid=93659) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Temporary image 072ecb03-14ef-40d5-b5aa-f22be4f2371e for user 900b83ee28b84a02b02d593d7f4443df is deleted. {{(pid=93659) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.volume.volume_utils [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Marking volume 45fdea7f-571b-4817-a5c1-f121bf67a443 as bootable. {{(pid=93659) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Copying metadata from image 072ecb03-14ef-40d5-b5aa-f22be4f2371e to 45fdea7f-571b-4817-a5c1-f121bf67a443. {{(pid=93659) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Creating volume glance metadata for volume 45fdea7f-571b-4817-a5c1-f121bf67a443 backed by image 072ecb03-14ef-40d5-b5aa-f22be4f2371e with: {'image_id': '072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9c501e8b7680d2b8198b489ee1aefa41', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93659) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 13:05:08 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (656868ae-d7f2-4d4f-9fc6-04b6f34cfbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45fdea7f-571b-4817-a5c1-f121bf67a443', 'volume_size': 1, 'image_id': '072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c501e8b7680d2b8198b489ee1aefa41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd1c9809b508447ad8f8a6a24808f6fae', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '90423bdc0ef4d47b67235bb0ea3744d18ff6888cfa909c6e496f34bc4b675fe1003963ee53532b7fc516e7b4818bc0706c1558c8ad9c41ec0c2c1c886f53a935', 'id': '072ecb03-14ef-40d5-b5aa-f22be4f2371e', 'created_at': datetime.datetime(2026, 6, 23, 11, 4, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 11, 4, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/072ecb03-14ef-40d5-b5aa-f22be4f2371e/file', 'properties': {}}, 'image_service': }' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f7ad91-b8aa-4ae4-83a9-1906c85d4951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:09 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Volume volume-45fdea7f-571b-4817-a5c1-f121bf67a443 (45fdea7f-571b-4817-a5c1-f121bf67a443): created successfully Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6f7ad91-b8aa-4ae4-83a9-1906c85d4951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Flow 'volume_create_manager' (289d1a59-5815-4a0f-a99f-8cdfc5eefe7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:05:09 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf" returned: 0 in 0.800s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-6c2500b3-aa5a-4845-a035-c54262ab4e34 tempest-VolumeImageDependencyTests-1791103867 None] Created volume successfully. Jun 23 13:05:09 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf Jun 23 13:05:09 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:09 devstack sudo[114902]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.info" returned: 0 in 0.680s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.479s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.719s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-602595344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdd34ac-e4fe-4b9d-8180-541aa0439958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa653b3923024f64a6089addfbaaf02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:05:07Z,use_quota=True,user_id='3ba63755155c412c960ae13c9eee5a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)}" {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Creating volume bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:05:09 devstack cinder-volume[93659]: INFO cinder.volume.drivers.remotefs [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] casted to osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 1073741824 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:09 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 1073741824 Jun 23 13:05:09 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:09 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a8ea60c1-2caa-427a-9b9b-0e2cb5cf90ab tempest-CinderUnicodeTest-315342380 None] Create snapshot completed successfully Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Acquiring lock "cinder-45fdea7f-571b-4817-a5c1-f121bf67a443-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Lock "cinder-45fdea7f-571b-4817-a5c1-f121bf67a443-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Acquiring lock "cinder-quobyte-45fdea7f-571b-4817-a5c1-f121bf67a443" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Lock "cinder-quobyte-45fdea7f-571b-4817-a5c1-f121bf67a443" acquired by "delete_volume" :: waited 0.019s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6edd8a4-6cc1-413c-9dc3-1bc17bc85ffb]: (4, 'raw') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:09 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-26ff4311-c1f8-40a3-acf3-a84d39547cbf" returned: 0 in 0.694s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-26ff4311-c1f8-40a3-acf3-a84d39547cbf" released by "delete_volume" :: held 1.553s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:09 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 Jun 23 13:05:09 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created reservations ['ba15fd4c-99e1-448c-bdad-46ed65437c0a', '508a2c05-3534-45e7-bb85-499b5fd7d672', '63ae9734-9b75-47f9-89ad-8f792b2af82c', '45c927f6-f1e9-42de-a7ed-4e0928e9ec3e'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:09 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:09 devstack sudo[114918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:09 devstack sudo[114918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "cinder-b5f2fe2b-b711-44e6-84e7-b345f73f5ad8-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-b5f2fe2b-b711-44e6-84e7-b345f73f5ad8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "cinder-quobyte-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "cinder-quobyte-b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Deleting offline snapshot b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 of volume bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] snapshot_file for this snap is: volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5e251a-c5aa-41b1-b202-e94c9cd8bc95]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-074c10db-cf47-4bbf-821e-6e4473b14594-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-074c10db-cf47-4bbf-821e-6e4473b14594-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:10 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 1073741824" returned: 0 in 1.082s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:10 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443" returned: 0 in 0.870s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:10 devstack sudo[114926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 Jun 23 13:05:10 devstack sudo[114926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-074c10db-cf47-4bbf-821e-6e4473b14594" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-074c10db-cf47-4bbf-821e-6e4473b14594" acquired by "delete_volume" :: waited 0.080s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:10 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 Jun 23 13:05:10 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:10 devstack sudo[114928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 Jun 23 13:05:10 devstack sudo[114928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8dc22c-9aa8-47dd-9bf5-47da88782ad2]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:10 devstack sudo[114918]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.976s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:10 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Deleted volume successfully. Jun 23 13:05:10 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-a330a6d1-2fc7-428a-abdc-5998e335cf0e tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-26ff4311-c1f8-40a3-acf3-a84d39547cbf-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:10 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 Jun 23 13:05:10 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:11 devstack sudo[114926]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" returned: 0 in 1.081s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[22790628-1b5d-4a9d-8949-ce8ba2311e7d]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:11 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958" returned: 0 in 0.937s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:11 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'} {{(pid=93659) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 13:05:11 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9b3b46-e3af-4819-a796-b55db22cb406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958', 'volume_size': 1}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5562e8e-ef27-4733-8659-e17f6353830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:11 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Volume volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 (bfdd34ac-e4fe-4b9d-8180-541aa0439958): created successfully Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5562e8e-ef27-4733-8659-e17f6353830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Flow 'volume_create_manager' (bd3be2ac-b1f3-471e-98be-7e03bd4389d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:05:11 devstack sudo[114928]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443" returned: 1 in 1.149s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443' failed. Not Retrying. {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:11 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-3ff789c6-0faf-403e-aa5b-188b0ee02bc2 tempest-SnapshotDependencyTests-771072030 None] Created volume successfully. Jun 23 13:05:11 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443 Jun 23 13:05:11 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:11 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594" returned: 0 in 0.944s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:11 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:11 devstack sudo[114951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594 Jun 23 13:05:11 devstack sudo[114951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Creating offline snapshot 6e7de2e9-4452-4d68-825d-3df68f0ee7cb of volume bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e41b13-b924-4ef0-9c3d-2fe58eefb937]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:12 devstack sudo[114953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 Jun 23 13:05:12 devstack sudo[114953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:12 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" returned: 0 in 0.993s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:12 devstack sudo[114960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 Jun 23 13:05:12 devstack sudo[114960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:12 devstack sudo[114951]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-074c10db-cf47-4bbf-821e-6e4473b14594" returned: 0 in 0.770s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-074c10db-cf47-4bbf-821e-6e4473b14594" released by "delete_volume" :: held 1.817s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:12 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-45fdea7f-571b-4817-a5c1-f121bf67a443" returned: 0 in 0.865s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Lock "cinder-quobyte-45fdea7f-571b-4817-a5c1-f121bf67a443" released by "delete_volume" :: held 2.972s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created reservations ['81e50c7a-cb22-4f25-9454-a20c2af17c2d', '2ee775a4-291e-4c9f-acb2-0f71fcf3b0da', 'e72297b2-b194-4921-b538-12aca42bc318', 'deb1be4c-9ad2-44c5-86f5-b07ca44b2d49'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Created reservations ['5da60606-91ed-4591-84da-335c0f3a6d7c', '21235188-3153-4f8f-b172-ccaa439e750a', '9136531e-d4be-4a19-9924-4858e408697d', '157a636f-e528-4ccc-a390-c18813782aed'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:12 devstack sudo[114962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:12 devstack sudo[114962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:12 devstack sudo[114963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:12 devstack sudo[114963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-2fdf7233-e55d-4502-b2ab-595c3e9dddde-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-2fdf7233-e55d-4502-b2ab-595c3e9dddde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-6d7f3e14-a96c-4353-b63f-0d7711784ed7" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-6d7f3e14-a96c-4353-b63f-0d7711784ed7" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-2fdf7233-e55d-4502-b2ab-595c3e9dddde" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-2fdf7233-e55d-4502-b2ab-595c3e9dddde" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Deleting offline snapshot 2fdf7233-e55d-4502-b2ab-595c3e9dddde of volume 6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] snapshot_file for this snap is: volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[629c74dc-7f97-461c-93e6-b32098e2679b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:12 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:13 devstack sudo[114966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde Jun 23 13:05:13 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:13 devstack sudo[114953]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958" returned: 0 in 1.084s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb 1G {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:13 devstack sudo[114973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb 1G Jun 23 13:05:13 devstack sudo[114973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:13 devstack sudo[114960]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" returned: 0 in 1.154s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:13 devstack sudo[114976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8 Jun 23 13:05:13 devstack sudo[114976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:13 devstack sudo[114962]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.129s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:13 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Deleted volume successfully. Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-cf252197-6398-4427-8704-ace8a8fd5ea1 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-074c10db-cf47-4bbf-821e-6e4473b14594-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:13 devstack sudo[114963]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 1.177s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:13 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:13 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Deleted volume successfully. Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-5b2ef897-dbad-4b35-aac3-2189686630ae tempest-VolumeImageDependencyTests-1791103867 None] Lock "cinder-45fdea7f-571b-4817-a5c1-f121bf67a443-delete_volume" released by "delete_volume" :: held 4.463s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:14 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde" returned: 0 in 1.219s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a1b170-3875-45ca-b9be-c30626dd0f93]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:14 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 Jun 23 13:05:14 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:14 devstack sudo[114976]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234.b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" returned: 0 in 0.856s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-b5f2fe2b-b711-44e6-84e7-b345f73f5ad8" released by "_delete_snapshot" :: held 4.250s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" released by "delete_snapshot" :: held 4.295s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Created reservations ['a7470f24-3a49-4759-be7f-31879caf7cbd', 'f63a01bc-f3be-404a-8af1-2a3579ff11f0', 'a3ff6f26-3988-4624-b656-d0051060bdc0', 'f485a2ce-db0c-4efd-b1b0-523969eda319'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:14 devstack sudo[114973]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb 1G" returned: 0 in 1.374s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:14 devstack sudo[114989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb Jun 23 13:05:14 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:14 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Delete snapshot completed successfully. Jun 23 13:05:14 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-b5b3557a-c0e1-4246-b9f0-41751a363146 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-b5f2fe2b-b711-44e6-84e7-b345f73f5ad8-delete_snapshot" released by "delete_snapshot" :: held 4.544s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:15 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7" returned: 0 in 1.000s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:15 devstack sudo[115028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde Jun 23 13:05:15 devstack sudo[115028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "cinder-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:15 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 -F qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb" returned: 0 in 0.969s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:15 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb is being set with open permissions: ugo+rw Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:15 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb Jun 23 13:05:15 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "cinder-quobyte-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" acquired by "delete_volume" :: waited 0.018s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[3184210a-e4e3-443b-ada2-39d8d5f1f8b5]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:15 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:15 devstack sudo[115037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 Jun 23 13:05:15 devstack sudo[115037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:16 devstack sudo[115028]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde" returned: 0 in 0.886s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:16 devstack sudo[115042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde Jun 23 13:05:16 devstack sudo[115042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:16 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb" returned: 0 in 0.758s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:16 devstack sudo[115047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.info Jun 23 13:05:16 devstack sudo[115047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:16 devstack sudo[115037]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" returned: 0 in 0.813s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:16 devstack sudo[115050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234 Jun 23 13:05:16 devstack sudo[115050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:16 devstack sudo[115042]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7.2fdf7233-e55d-4502-b2ab-595c3e9dddde" returned: 0 in 0.674s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-2fdf7233-e55d-4502-b2ab-595c3e9dddde" released by "_delete_snapshot" :: held 3.921s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-6d7f3e14-a96c-4353-b63f-0d7711784ed7" released by "delete_snapshot" :: held 3.952s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created reservations ['47d0aa90-a84b-4b6e-bea0-7f13677aa0ab', '4c1dc097-c024-4a1f-b144-deaf56c0dd62', '9667d7d4-1c36-476e-90f8-f90aee21ab63', '0bf8d45b-f81e-480e-bf54-16f6bfc33b6b'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:16 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Delete snapshot completed successfully. Jun 23 13:05:16 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9c7ad0ee-42c9-48c4-a70d-1f186d5f0ff0 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-2fdf7233-e55d-4502-b2ab-595c3e9dddde-delete_snapshot" released by "delete_snapshot" :: held 4.101s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-6d7f3e14-a96c-4353-b63f-0d7711784ed7-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-6d7f3e14-a96c-4353-b63f-0d7711784ed7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:17 devstack sudo[115047]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.info" returned: 0 in 0.730s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:17 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.info is being set with open permissions: ugo+rw Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.info {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "cinder-quobyte-6d7f3e14-a96c-4353-b63f-0d7711784ed7" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:17 devstack sudo[115054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.info Jun 23 13:05:17 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-6d7f3e14-a96c-4353-b63f-0d7711784ed7" acquired by "delete_volume" :: waited 0.021s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e38c6c-1ee9-4e9a-850f-ef8a1e78bcfd]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:17 devstack sudo[115050]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" returned: 0 in 0.740s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234" released by "delete_volume" :: held 1.609s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:17 devstack sudo[115057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 Jun 23 13:05:17 devstack sudo[115057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Created reservations ['3edeb5a3-0ddb-45c8-a1c6-789903a37cc8', 'b1a4c28b-6e6b-4bec-bc9d-74ff6b30bcb5', 'e57b639c-461c-4184-b5f2-dd3b167b45e1', 'faf08fe2-f83c-4b2f-a1c4-33c20b5c652b'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:17 devstack sudo[115059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:17 devstack sudo[115059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:17 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.info" returned: 0 in 0.686s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.711s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "cinder-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:17 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-a3d554ca-6534-47fa-ac79-32fc26033626 tempest-SnapshotDependencyTests-771072030 None] Create snapshot completed successfully Jun 23 13:05:17 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "cinder-quobyte-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2ce189-43e1-42eb-8c46-5c4a694bb611]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:18 devstack sudo[115057]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7" returned: 0 in 0.874s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:18 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 Jun 23 13:05:18 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:18 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7 Jun 23 13:05:18 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:18 devstack sudo[115059]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.749s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:18 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Deleted volume successfully. Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-9d8ff754-f246-4fbc-b119-bbddd7cddba5 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-bf0a7d58-c18b-4cdf-bc2e-db31bd8ee234-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:18 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-6d7f3e14-a96c-4353-b63f-0d7711784ed7" returned: 0 in 0.705s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:18 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15" returned: 0 in 0.817s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-quobyte-6d7f3e14-a96c-4353-b63f-0d7711784ed7" released by "delete_volume" :: held 1.657s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:18 devstack sudo[115075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15 Jun 23 13:05:18 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:18 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Created reservations ['4d67b925-4aee-4632-8c92-040a7bc2b195', 'f088f292-4135-41fd-8c39-0f97994b459b', 'd0ec5012-5393-4a34-976d-64dba9c833a6', 'f810c65f-73d6-460f-bd85-1423fccf46ef'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:19 devstack sudo[115077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:19 devstack sudo[115077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.flows.manager.create_volume [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93659) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Flow 'volume_create_manager' (4b7e60fd-0db4-421b-8d49-8bb4743b8007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3cbcf6-c7b3-4cbd-b6b8-98ab71a876af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b3cbcf6-c7b3-4cbd-b6b8-98ab71a876af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T11:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32f7638-d33a-4e4c-a8b5-d6b101d173b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa653b3923024f64a6089addfbaaf02c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T11:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6e7de2e9-4452-4d68-825d-3df68f0ee7cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T11:05:19Z,use_quota=True,user_id='3ba63755155c412c960ae13c9eee5a20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3147160b-84d2-4030-984c-5baf1d94bab5),volume_type_id=3147160b-84d2-4030-984c-5baf1d94bab5)' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327c7432-6495-4aec-9541-56297a1245b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327c7432-6495-4aec-9541-56297a1245b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f29783-ed58-48c8-a4ea-162b3ba36dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f29783-ed58-48c8-a4ea-162b3ba36dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b32f7638-d33a-4e4c-a8b5-d6b101d173b8', 'volume_name': 'volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8', 'volume_size': 1, 'snapshot_id': '6e7de2e9-4452-4d68-825d-3df68f0ee7cb'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94335d3a-a8bc-4791-875c-8625f536427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94335d3a-a8bc-4791-875c-8625f536427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50865f6-c60f-4cfd-8ebc-e3ebb194eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:19 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Volume b32f7638-d33a-4e4c-a8b5-d6b101d173b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8', 'volume_size': 1, 'snapshot_id': '6e7de2e9-4452-4d68-825d-3df68f0ee7cb'} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-quobyte-6e7de2e9-4452-4d68-825d-3df68f0ee7cb-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" by "_create_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-6e7de2e9-4452-4d68-825d-3df68f0ee7cb-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Creating volume b32f7638-d33a-4e4c-a8b5-d6b101d173b8 from snapshot 6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Selected osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9 as target Quobyte volume. {{(pid=93659) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-quobyte-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" by "_copy_volume_from_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] snapshot: 6e7de2e9-4452-4d68-825d-3df68f0ee7cb, volume: b32f7638-d33a-4e4c-a8b5-d6b101d173b8, {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e599e2-f7e4-4af5-8423-eefbaedb170b]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:19 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb Jun 23 13:05:19 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:19 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15" returned: 0 in 0.755s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-quobyte-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15" released by "delete_volume" :: held 1.622s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Created reservations ['a3fe0405-279d-4dab-856a-026e89c86fb7', '6ae0c809-8b58-470e-95f7-6bf3f1ef0736', '25925bdc-9730-474b-942c-521acf17df9e', 'bd3addcc-d2c3-42cb-a4b3-b98077981eb1'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:19 devstack sudo[115077]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.790s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:19 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Deleted volume successfully. Jun 23 13:05:19 devstack sudo[115083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:19 devstack sudo[115083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:19 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-44782e83-d93d-4e76-af76-7ac931c40a75 tempest-CreateVolumesFromSnapshotTest-1858124751 None] Lock "cinder-6d7f3e14-a96c-4353-b63f-0d7711784ed7-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:20 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb" returned: 0 in 1.091s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Creating direct copy from snapshot {{(pid=93659) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ee0db8-8a64-4b9a-a12a-062349ba6c4e]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:20 devstack sudo[115083]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.886s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:20 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Deleted volume successfully. Jun 23 13:05:20 devstack sudo[115089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 Jun 23 13:05:20 devstack sudo[115089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:20 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-48e9e0fb-7190-4e27-8f97-e551b9960187 tempest-CinderUnicodeTest-315342380 None] Lock "cinder-935ea3ea-0d9c-44ea-a31d-4ad5781a0f15-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:21 devstack sudo[115089]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958" returned: 0 in 1.113s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:21 devstack cinder-volume[93659]: DEBUG cinder.utils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Path /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 not found in is_blk_device check {{(pid=93659) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 13:05:21 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:21 devstack sudo[115095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 Jun 23 13:05:21 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:22 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:05:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:22 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:22 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:22 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:22 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:23 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:23 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.938s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:23 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:23 devstack cinder-volume[93659]: DEBUG oslo_service.periodic_task [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] Running periodic task VolumeManager._thread_info {{(pid=93659) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 13:05:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread count: 28 {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 13:05:23 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-a06a124d-2ed9-4dbe-9118-62f6a9dd6104 None None] thread info: [<_MainThread(MainThread, started 136356020326528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93659) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 13:05:26 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" returned: 0 in 4.547s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:26 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[c713edaa-15c5-4d51-8f04-e5fa512988c9]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:26 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:26 devstack sudo[115111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 Jun 23 13:05:26 devstack sudo[115111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:27 devstack sudo[115111]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958" returned: 0 in 0.894s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG cinder.image.image_utils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Image conversion details: src /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 {{(pid=93659) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 13:05:27 devstack cinder-volume[93659]: INFO cinder.image.image_utils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Converted 1024.00 MB image at 225.14 MB/s Jun 23 13:05:27 devstack cinder-volume[93659]: WARNING cinder.volume.drivers.remotefs [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 is being set with open permissions: ugo+rw Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:27 devstack sudo[115116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 Jun 23 13:05:27 devstack sudo[115116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:27 devstack sudo[115116]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" returned: 0 in 0.682s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" released by "_copy_volume_from_snapshot" :: held 8.452s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-6e7de2e9-4452-4d68-825d-3df68f0ee7cb-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" released by "_create_volume_from_snapshot" :: held 8.502s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.527s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50865f6-c60f-4cfd-8ebc-e3ebb194eb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8', 'volume_size': 1, 'snapshot_id': '6e7de2e9-4452-4d68-825d-3df68f0ee7cb'}' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351f874d-dbea-4596-9c7d-072b7a2dd89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 13:05:27 devstack cinder-volume[93659]: INFO cinder.volume.flows.manager.create_volume [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Volume volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 (b32f7638-d33a-4e4c-a8b5-d6b101d173b8): created successfully Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351f874d-dbea-4596-9c7d-072b7a2dd89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93659) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 13:05:27 devstack cinder-volume[93659]: DEBUG cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Flow 'volume_create_manager' (4b7e60fd-0db4-421b-8d49-8bb4743b8007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93659) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 13:05:27 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-63eb4953-3eca-4b23-bb2e-8f7d597c8bcd tempest-SnapshotDependencyTests-771072030 None] Created volume successfully. Jun 23 13:05:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-6e7de2e9-4452-4d68-825d-3df68f0ee7cb-delete_snapshot" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-6e7de2e9-4452-4d68-825d-3df68f0ee7cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-quobyte-bfdd34ac-e4fe-4b9d-8180-541aa0439958" by "delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-bfdd34ac-e4fe-4b9d-8180-541aa0439958" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:28 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-quobyte-6e7de2e9-4452-4d68-825d-3df68f0ee7cb" by "_delete_snapshot" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-6e7de2e9-4452-4d68-825d-3df68f0ee7cb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Deleting offline snapshot 6e7de2e9-4452-4d68-825d-3df68f0ee7cb of volume bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] snapshot_file for this snap is: volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3acd53-4e56-4221-84f4-eaa076ea865a]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:29 devstack sudo[115126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb Jun 23 13:05:29 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:29 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb" returned: 0 in 0.823s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.remotefs [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93659) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39c293-747c-4ffc-bf33-fe521865b810]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:29 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:29 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 Jun 23 13:05:29 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:30 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958" returned: 0 in 0.809s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:30 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:30 devstack sudo[115136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb Jun 23 13:05:30 devstack sudo[115136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:31 devstack sudo[115136]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb" returned: 0 in 0.708s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:31 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:31 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb Jun 23 13:05:31 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:32 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:32 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958.6e7de2e9-4452-4d68-825d-3df68f0ee7cb" returned: 0 in 0.621s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-6e7de2e9-4452-4d68-825d-3df68f0ee7cb" released by "_delete_snapshot" :: held 3.058s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-bfdd34ac-e4fe-4b9d-8180-541aa0439958" released by "delete_snapshot" :: held 3.080s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:32 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Created reservations ['a217bd0d-bd0f-42b8-b265-de123878c822', '649f4542-2a38-4ea9-b08d-3e27064ab8dd', '905a3a8a-b813-4444-9a3b-f72bcd4cc250', '2e5617b7-3f22-4197-b1c9-2a1e652d5d0e'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:32 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Delete snapshot completed successfully. Jun 23 13:05:32 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-2a3f1e44-2c8b-4700-a0ed-334209a01e55 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-6e7de2e9-4452-4d68-825d-3df68f0ee7cb-delete_snapshot" released by "delete_snapshot" :: held 3.203s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-bfdd34ac-e4fe-4b9d-8180-541aa0439958-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-bfdd34ac-e4fe-4b9d-8180-541aa0439958-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-quobyte-bfdd34ac-e4fe-4b9d-8180-541aa0439958" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:33 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-bfdd34ac-e4fe-4b9d-8180-541aa0439958" acquired by "delete_volume" :: waited 0.015s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:33 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[70518c7e-c0ec-437b-a64e-891392768ec6]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:33 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:33 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 Jun 23 13:05:33 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:34 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958" returned: 0 in 0.773s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:34 devstack sudo[115149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958 Jun 23 13:05:34 devstack sudo[115149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:34 devstack sudo[115149]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-bfdd34ac-e4fe-4b9d-8180-541aa0439958" returned: 0 in 0.737s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-bfdd34ac-e4fe-4b9d-8180-541aa0439958" released by "delete_volume" :: held 1.571s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Created reservations ['2a8e88e4-3e99-4bad-8363-626f501f2ae9', '3f18ef81-30ad-4b0f-9ea1-a644657716af', '7dcad8f2-41cb-43ee-a80e-88d92d195898', 'd39111c9-4029-44af-8707-57f330b82f6a'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:34 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:34 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:34 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-b32f7638-d33a-4e4c-a8b5-d6b101d173b8-delete_volume" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-b32f7638-d33a-4e4c-a8b5-d6b101d173b8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "cinder-quobyte-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" by "delete_volume" {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" acquired by "delete_volume" :: waited 0.016s {{(pid=93659) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa59cec-c95f-42c5-a487-248624f85300]: (4, 'qcow2') {{(pid=94730) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:35 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.676s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:35 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Deleted volume successfully. Jun 23 13:05:35 devstack sudo[115155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 Jun 23 13:05:35 devstack sudo[115155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:35 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f629b461-8712-464e-a9ab-7db911931d1f tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-bfdd34ac-e4fe-4b9d-8180-541aa0439958-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:36 devstack sudo[115155]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" returned: 0 in 0.771s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:36 devstack sudo[115160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8 Jun 23 13:05:36 devstack sudo[115160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:36 devstack sudo[115160]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:36 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69/volume-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" returned: 0 in 0.639s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:36 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-quobyte-b32f7638-d33a-4e4c-a8b5-d6b101d173b8" released by "delete_volume" :: held 1.447s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG cinder.quota [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Created reservations ['5797f2c5-85ab-4248-b23a-be830f4fc001', '85452e3b-fe4b-4456-993a-b025e2b9b6a7', '8a7fd10e-a06e-4396-aa09-0dee1cfb021d', '6a09d327-a05d-4606-9bc8-ff81f308ce15'] {{(pid=93659) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9': None} {{(pid=93659) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1072f994-3212-4e43-a95c-b2b31a4274f9'] {{(pid=93659) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.lockutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93659) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 13:05:37 devstack sudo[115163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69 Jun 23 13:05:37 devstack sudo[115163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 13:05:37 devstack sudo[115163]: pam_unix(sudo:session): session closed for user root Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG oslo_concurrency.processutils [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1b4fdeb68d0d8d409e8acda10ecdfb69" returned: 0 in 0.639s {{(pid=93659) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG cinder.manager [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Notifying Schedulers of capabilities ... {{(pid=93659) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 13:05:37 devstack cinder-volume[93659]: INFO cinder.volume.manager [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Deleted volume successfully. Jun 23 13:05:37 devstack cinder-volume[93659]: DEBUG cinder.coordination [None req-f1fe2c5c-08e7-43fc-aecb-ae4e407ceb80 tempest-SnapshotDependencyTests-771072030 None] Lock "cinder-b32f7638-d33a-4e4c-a8b5-d6b101d173b8-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=93659) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 13:05:47 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:DELETE=9,cinder:SELECT=94,cinder:UPDATE=132,cinder:INSERT=29 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 13:05:47 devstack cinder-volume[93659]: DEBUG dbcounter [-] [93659] Writing DB stats cinder:UPDATE=129,cinder:SELECT=100,cinder:DELETE=14,cinder:INSERT=43 {{(pid=93659) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}